+

WO2013000559A1 - Dispositif d'acquisition de données représentant un objet virtuel - Google Patents

Dispositif d'acquisition de données représentant un objet virtuel Download PDF

Info

Publication number
WO2013000559A1
WO2013000559A1 PCT/EP2012/002676 EP2012002676W WO2013000559A1 WO 2013000559 A1 WO2013000559 A1 WO 2013000559A1 EP 2012002676 W EP2012002676 W EP 2012002676W WO 2013000559 A1 WO2013000559 A1 WO 2013000559A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
force
handle
data acquisition
acquisition device
Prior art date
Application number
PCT/EP2012/002676
Other languages
English (en)
Inventor
Olivier Lambercy
Roger Gassert
Marie-Christine Fluet
Original Assignee
Eth Zurich
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from EP11005192A external-priority patent/EP2540226A1/fr
Application filed by Eth Zurich filed Critical Eth Zurich
Publication of WO2013000559A1 publication Critical patent/WO2013000559A1/fr

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1124—Determining motor skills
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/22—Ergometry; Measuring muscular strength or the force of a muscular blow
    • A61B5/224—Measuring muscular strength
    • A61B5/225—Measuring muscular strength of the fingers, e.g. by monitoring hand-grip force
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2505/00—Evaluating, monitoring or diagnosing in the context of a particular type of medical care
    • A61B2505/09—Rehabilitation or training
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches

Definitions

  • Data acquisition device representing a virtual object
  • the present invention relates to a data acquisition device representing a virtual object adapted to be attached to a positional sensing device according to the preamble of claim 1. Furthermore, the invention is related to a method and system for detecting and evaluating data relating to manipulation of a handle by a human subject.
  • a stylus that has two switches that can be pressed by a subject manipulating the stylus to perform actions in a virtual environment, such as selecting virtual objects, is known from WO 2005/043365.
  • Said stylus is a data acquisition device which can e.g. be attached to a positional sensing device which is preferably equipped with a feedback system.
  • a positional sensing device is also disclosed in WO 2005/043365 and provides the functions of 6 DOF positional sensing and 3 DOF force feedback.
  • the device according to the prior art can be used to evaluate the handling capability of subjects, especially from impaired patients. It is noted that this stylus provides the possibility of a user input through a switch and/or a push-button.
  • the stylus can be replaced by a computer mouse or digitizer.
  • the user interface according to WO 2005/043365 cannot measure the grasping force applied by the subject.
  • Daily activities of humans are strongly dependent on the use of arms and hands, and thus people suffering from functional deficits of the upper limb, e.g. following a stroke, are often severely impaired in the execution of simple tasks.
  • the choice of appropriate therapy to recover lost abilities requires proper assessment of the functional deficits.
  • peg insertion test One known exercise to evaluate the possibility of a subject to execution of tasks using his arm and hand is the so called peg insertion test. Said test consists of moving nine pegs provided into a 3x3 array of holes having dimensions to accommodate the pegs, wherein the pegs are provided in a predefined starting position.
  • a peg board test is known from JP 2010/057629, provided for testing autonomous physical strength.
  • the physical strength testing device has a peg board having a plurality of holes longitudinally provided in a row at both right and left ends and a plurality of holes longitudinally provided in two rows in the central portion and allowing a plurality of pegs to be inserted and pulled out of the holes.
  • the peg board is put on a table and the subject of measurement inserts and pulls out the pegs between the holes in the right and left ends and the holes in the central portion.
  • the time required in insertion and pulling out is measured.
  • the measured time is compared with an evaluation criterion table previously obtained by experiments to test the subject's autonomous physical strength relating to the handiwork.
  • WO 2011/036350 discloses a device for evaluating and/or reinforcing gripping strength.
  • Said device comprises electronic circuits built into a hollow space and consists of a functional combination of a pressure-measuring system with a wireless communication system and a power store for powering the pressure-measuring system and the wireless communication system.
  • the self-contained object has a spherical shape, being made of a flexible airtight material, and having a size suitable for being grasped and compressed by a single hand.
  • the airtight system has the advantage to react on any change of pressure by a hand grasping the device and the disadvantage that it can not be easily adapted to a haptic feedback system, in view of the hollow gas pressure based detection sensor, necessitating the flexible airtight outer sphere.
  • the Virtual Peg Insertion Test of the present invention allows assessing sensorimotor functions of arm and hand using an instrumented tool, virtual reality and haptic feedback.
  • Such a method and device allows deriving a plurality of performance parameters from kinematic and kinetic data, which can be compared between two groups of healthy subjects performing the task with the dominant and non-dominant hand, as well as with a group of chronic stroke subjects suffering from different levels of upper limb impairment.
  • the invention combines virtual reality and an augmented haptic interface that can provide kinesthetic feedback through an instrumented handle grasped by the subject to provide a better tool for the assessment of arm and hand function.
  • the test according to the system consists of a functionally relevant pick and place task. It combines reaching and grasping movements and thus involves both proximal and distal parts of the limb. During the task, the position and the orientation of the hand, the grasping force and the collision forces with the virtual board are measured in function of time. These measures can provide information about movement smoothness, joint coordination, muscle strength and sensory perception, all parameters found to be important in clinical assessments.
  • the present testing device and related method provides an objective, reliable and sensitive test for the assessment of arm and hand function.
  • Said robotic device improves current clinical assessments since it provides a platform for objective measures of impairment.
  • the system can precisely record movement trajectories, execution time and interaction forces during well-controlled and repeatable motor tasks to characterize movements of neurologically disabled subjects.
  • the device has been used to acquire grasping force profiles from tests with stroke subjects.
  • the stored grasping force profiles show significantly smaller grasping forces applied by them compared to the healthy subjects and suggest a poor coordination between position and grasping for the stroke subjects.
  • the collision forces with the virtual board were found to be indicative of sensory deficits. Since these results improve with training of the patients, the analyzed parameters are valid indicators of impairment and its development.
  • the aim of the invention is to improve assessment of hand and arm function of neurologically disabled patients using a haptic device in combination with an instrumented handle according to an embodiment and with a novel data analysis method.
  • the patient's motion and forces are measured by the robotic device, which in turn will provide visual and haptic feedback to render more realistic conditions during virtual object manipulation.
  • the device allows for measurements with healthy and stroke subjects to evaluate the sensitivity of the test by comparing performances of healthy subjects executing the task with the dominant hand versus the non-dominant hand and to obtain baseline measures. Furthermore, these measurements aimed at determining the types of stroke subjects able to perform the task as well as identifying meaningful performance parameters representative of important sensorimotor functions .
  • the invention provides the device and method to execute a Virtual Peg Insertion Test, an objective, easy and fast to administer assessment test of arm and hand function using a haptic interface and an instrumented handle which can measure grasping forces. Measurements with several stroke subjects and found that subjects with some remaining fine motor skills could perform the Virtual Peg Insertion Test.
  • Nine parameters related to task performance are compared within test results of stroke subjects and healthy subjects performing the task with the dominant and non-dominant hand. Eight of the nine parameters analyzed showed differences between the groups of healthy and stroke subjects and thus have the potential to be valid indicators of functional impairment. Previous studies have demonstrated how similar parameters could be indicative of some impairments, such as sensory deficits, muscle weakness and abnormal joint coordination, as discussed in more details below.
  • the data acquisition device represents a virtual object which can be represented for the user on a screen. It is at the same time a real object comprising a handle and is adapted to be attached to a positional sensing device. Said positional sensing device is optionally and preferably also a force feedback device.
  • the handle incorporates at least one sensor, usually at least two or three sensors, allowing a user of the device to issue a handling signal when grasping the handle.
  • the handle now comprises at least two surface areas adapted to be pushed in direction of the body or core of the handle.
  • the mentioned at least one force sensor is associated with one surface area which can be thus adapted to sense a pushing force of the user grasping and/or pressing the handle via the surface areas.
  • one force sensor is associated to one corresponding surface area, so that grasping forces from more than one direction can be sensed.
  • the handle can have the outer form of essentially a sphere, wherein the surface areas are then part-spherical surfaces, attached resiliently to the body of the handle. If there are two surface areas these are essentially semi-spherical surfaces separated by a slot. If there are three surface areas these are essentially part-spherical surfaces separated by slots. Preferably the three surface areas join at the "poles" of the handle and cover 120 degree along a half great circle.
  • the method for detecting and evaluating data relating to manipulation, by a human subject uses a data acquisition device comprising a handle and a haptic interactive representation on a display of a computer unit. Then the position of a hand of a user is sensed in real space and force feedback to said user is provided using a haptic interface device. Signals are obtained through force sensors within the data acquisition device when said handle, attached to the haptic interface device, is grasped by the user.
  • a graphical representation of a predefined number test objects to be displaced on the screen of the computer unit from one predefined place to another through real movement of the hand of the user grasping said data acquisition device is provided, wherein the progress of the test depends on the input provided through signals of the data acquisition device and the position and orientation signals provided by the haptic interface device.
  • the haptic device delivers a force feedback action when the representation of the data acquisition device vvdthin the representation on the screen collides with other objects in the virtual space, based on control signals issued by the computer controlling the displacement of the test objects when the data acquisition device is grasped with a force over a predefined threshold detected by the force sensors.
  • Said computer unit further gathers force data from the force sensors together with related time data and position data of the test objects to be used to evaluate the test progress. Further embodiments of the invention are laid down in the dependent claims.
  • Fig. 1 shows a schematic view of a force feedback haptic interface comprising a data acquisition device according to an embodiment of the invention
  • Fig. 2 shows A) a section and B) a perspective view of a first embodiment of a two-portion handle according to the invention
  • Fig. 3 shows A) a section and B) a perspective view of a second embodiment of a three-portion handle according to the invention
  • Fig. 4 shows a schematic representation in a front view on a display of a typical movement of a virtual peg in the test according to the invention and typical parameters used to evaluate the results of the test;
  • Fig. 5 shows trajectories of a representative healthy subject and a stroke subject during the execution of a complete trial of the Virtual Peg Insertion Test
  • Fig. 6 shows the grasping force in function of time of a healthy subject and a stroke subject (SI) during the execution of a complete trial of the Virtual Peg Insertion Test
  • Fig. 7 shows a flowchart of the method of a virtual peg test according to the invention.
  • Fig. 1 provides a schematic view of a force feedback haptic interface comprising a data acquisition device 5 according to an embodiment of the invention;
  • the data acquisition device 5 allows detecting data from users grasping said device via a handle 10.
  • the handle 10 can e.g. be attached to a positional sensing device 60 via a docking station 61 providing the connection with the positional sensing device 60.
  • the positional sensing device 60 is preferably equipped with a feedback system and constitutes a haptic device.
  • Such a sensing device 60 is available from PHANTOM Omni, SensAble Technologies, Inc., USA and the function of its 6 DOF positional sensing and 3 DOF force feedback elements are described in WO 2005/043365.
  • the data provided by that device are communicated via line 62 to a g computer 55 and said line is also adapted to provide force feedback information to the haptic device 60.
  • Fig. 1 provides a functional representation of the handle 10 including in an embodiment three single-axis force sensors 121, 122 and 123 (CentoNewton 40, EPFL, Switzerland) placed on a parallel flexible structure in order to measure the grasping force exerted on surrounding surface areas of the handle, which surface areas have the general reference numeral 1 10 in Fig. 1 and will be seen in more detail in connection with Fig 2 and 3.
  • the data acquisition device 5 comprises an inertial measurement unit 30, or IMU, to report on the handle's velocity and/or acceleration, which can be realized using a combination of accelerometers.
  • the optional IMU 30 comprises three accelerometers.
  • the three accelerometers are placed such that their measuring axes are orthogonal to each other. Preferably their measuring axes are oriented in the same direction as the axes of the force sensors 121, 122 and 123.
  • additional measurement devices 40 which may comprise three gyroscopes, can be included in the handle 10.
  • All measurement devices 121, 122, 123, 30 and 40 are connected to the computer 55, usually via supply and data lines 45 and treated with a data acquisition card 50.
  • the lines 45 show a separate connection via the data acquisition card 50 and data lines 56 to the computer 55, it is clear that these lines 45 are preferably integrated via the docking station 61 or a connection with the positional sensing device 60, or they can also be implemented with a wireless connection.
  • Fig. 2 shows A) a section and B) a perspective view of a first embodiment of a two-portion handle 15 according to the invention.
  • the handle 15 comprises an adapter 101 being the core of the handle or data acquisition device 15.
  • a groove 102 may be provided to attach adapter 101 to the docking station 61 of the haptic device 60, since the haptic device 60 provides the position detection and the force feedback function, relating to position and orientation (rotation) of the data acquisition device 15.
  • the adapter 101 is surrounded with a mantle 103 providing a rod prolongation of the docking station 60.
  • this adapter 102 provides the basis for the two semi-spherical handle portions 111 and 112, mounted on the core of the adapter 101.
  • the portions 11 1 and 112 are separated one against the other by a slit 109 wherein they arc mounted with a round slit 108 at the basis of the adapter 101 and mantle 103.
  • the hollow semi-spherical handle portions 1 11 and 112 are attached with two screws 107 on a multi-slotted support 105.
  • Each support 105 provides the connection between the hollow semi-spherical handle portion 111 or 112, respectively, and the core sleeve 106. Beside a flat structure mainly in the plan of the drawing of Fig. 2A it sis preferred that it covers a room angle up to the semi-sphere behind the cover handle portion 11 1 or 112, respectively.
  • one force sensor 121 or 122 is mounted, respectively, wherein a pretension screw 21 or 22 is provided within the support 105 against the sensor 21, 22.
  • the support 105 is connected with the hollow central sleeve 106 mounted on the adapter 101.
  • the slotted support 105 allow for the sensors 121 and 122 to be accommodated and to be actuated when a semi-spherical handle portions 11 1 or 112 is pushed against the central sleeve 106.
  • the design of the present embodiment has a spherical shape which is easy to grasp and manipulate by stroke subjects with impaired hand function.
  • the diameter of the sphere built by the semi-spherical handle portions 111 and 1 12 can be adapted to different hand sizes; usually it is chosen to have a diameter between 5 and 10 centimetres.
  • Fig. 3 shows A) a section and B) a perspective view of a second embodiment of a three- portion handle 25 according to the invention.
  • the handle 25 comprises an adapter 101 being the core of the handle or data acquisition device 25.
  • Adapter 102 with its surrounding hollow cylindrical sleeve 106 provides the basis for the three part-spherical handle portions 111, 112 and 1 13 comprising approximately 120 degree of the circle.
  • the three portions 1 11, 1 12 and 113 are joining at a single point opposite to adapter 101, separated one against the other by a sht 109 wherein they are mounted with a round slit 108 at the basis of the adapter 101 and mantle 103.
  • the hollow handle portions 111, 112 and 1 13 are attached with two screws 107 each on a multi-slotted support 105.
  • Each support 105 attaches the corresponding hollow handle portions 1 11, 112 or 1 13 to the core 106, wherein the slots within the portions allow mounting of force sensor 121, 122 or 123, respectively, and compression of these sensors when the corresponding handle portions 111, 112 or 113 is pushed, generating a signal proportional to the mean force exerted on the corresponding handle portion.
  • This design having three handle portions allows an improved signal generation, since three different signals oriented at an angle of 120 degrees in the plane of the longitudinal direction of the pretension screws (only screws 21 and 22 are shown in the drawings).
  • the devices 15 and 25 according to Fig. 2 and 3 were tested with a haptic device 60 according to WO 2005/043365, wherein it communicated with the computer 55 over a PCMCIA FireWire card.
  • the grasping force is acquired through a USB data acquisition card 50.
  • the data and supply lines 45 were provided not integrated with the docking station 61.
  • the data acquisition device 5 i.e. the handles 15 or 25 according to Fig. 2 or 3, respectively, attached to the positional sensing device 60, allows execution of a Virtual Peg Insertion Test consisting in grasping nine virtual pegs, one after the other, and inserting them into nine holes as quickly as possible.
  • This test combines virtual reality and haptics.
  • the haptic interface 60 provides kinesthetic feedback to the subject's hand in order to render a realistic reconstitution of the interaction with a real environment and precisely tracks the movement.
  • the sensors 121, 122 and 123 were dynamically loaded and unloaded (up to 100 N/s) to three force levels (approximately 10, 20 and 30 N) against a commercial load cell (Mini 40, ATI Industrial Automation, USA) while the voltage output of the piezoresistive sensor was measured.
  • the measured force data were lowpass filtered at 50 Hz and show good linearity between the applied force [Newton] and the output voltage [Volt].
  • Grasping forces are acquired over a USB data acquisition card (NI USB 6008, National Instruments, USA) while the position, angles and collision forces are acquired through a firewire connection, which also sends the commands from the physics engine for the forces to be displayed to the device.
  • the task is implemented in Microsoft Visual C++ and OpenGL is used for graphic rendering. All signals are sampled at a rate of 1 kHz and are stored on a laptop (IntelCore 2, 2.67 GHz, Windows XP) as computer 55.
  • the connection diagram is shown in Fig. 1. The complete setup is compact and can be easily transported and integrated in a clinical environment.
  • the sensor data is stored within memory of the computer 55, especially during the test procedure and preferably from the group of force data (exerted by the hand of the user through grasping the handle), position data (of the handle), path data (of the handle in the real world or its representation of a cursor in the virtual world and of the pegs), rotation data (of the handle and/or pegs), velocity data (of the handle), acceleration data (of the handle), angular velocity data (of the handle) and angular acceleration data (of the handle), wherein preferably the data is always stored in connection with time data to reference the progress of the test.
  • the device was tested with three groups of subjects performing the Virtual Peg Insertion Test, two groups of 8 healthy subjects each and one group of 14 chronic stroke subjects.
  • the first group (three females and five males, age 29 ⁇ 5 years) performed the task with their dominant hand
  • the second group (one female and seven males, age 29 ⁇ 3 years) with the non-dominant hand
  • the group of stroke subjects (three females and eleven males) with their impaired hand.
  • Stroke subjects were recruited on a patient-by-patient basis from the ZAR in Zurich, Switzerland (Center for ambulatory rehabilitation, Zurich).
  • the ZAR classifies patients into four categories based on their motor impairment level as described in Table I. Subjects of all four levels of impairment were tested (one AO, two Al, three A2 and eight A3).
  • AO relates to a subject with "no arm movement”; Al relates to “arm movements are significantly restricted”; A2 relates to "fine motor skills are restricted; impairment is pronounced”; and A3 relates to "fine motor skills are restricted; impairment is mildly pronounced”.
  • Subjects were seated in front of a laptop and held the handle 15 or 25 attached to a device according to WO 2005/043365 in its initial position with the elbow flexed about 90 degrees and the shoulder abducted about 45 degrees.
  • a blue board with a virtual board plane 200 was displayed on the screen of the laptop 55 with nine pegs 210 aligned vertically on the left which had to be moved and inserted into nine holes 220 displayed in a 3x3 matrix on the right.
  • Fig. 4 shows a schematic representation of a display of a typical movement 201, 202, 203, 204, 205 and 206 of a virtual peg 210 to a virtual hole 220 in the test according to the invention and typical parameters used to evaluate the results of the test.
  • the subject had to manipulate the handle 15 or 25 which was represented by a cursor (not represented in Fig. 4) on the screen.
  • the cursor had to be properly aligned with a peg 210 before grasping, and the (virtual) peg 210 would fall on the (virtual) board plane 200, if the grasping force was not maintained above a predefined threshold, e.g. 5 Newton.
  • the cursor has a specific color according to the progress of the experiment. Information about the different colors of the cursor and the pegs 210 was given to the subject before the experiment was started.
  • the cursor is transparent yellow when no peg 210 is held, turns orange to indicate that it is properly aligned with a peg 210, green when a peg 210 is currently held and red when excessive grasping force is applied to the handle but no peg 210 is held.
  • the subject was instructed to insert the nine pegs 210 into the nine holes 220 as fast and as precisely as possible using only the tested hand. In order to insert a peg 210 into a hole 220, the grasp had to be released below said force threshold. The test was completed once all pegs 210 were inserted into the nine holes 220.
  • the pegs 210 could be taken in any order and inserted into any free hole 220.
  • the difficulty of the task was adapted to the level of impairment of the stroke subjects. To do so, two task parameters were varied: the grasping force threshold, calculated as the mean of the three force sensors (between 1 and 5 Newton, wherein the value of 5 Newton was used for healthy subjects), and the maximal distance between the real position of the handle, represented by the virtual position of the cursor and the corresponding virtual peg position for the alignment (between 3 and 10 mm, wherein the value of 3 mm was used for healthy subjects).
  • the alignment was calculated as the mean of the distance between the top of the cursor and peg 210 and the distance between the bottom of the cursor and peg 210 in order to account for both the position and the orientation.
  • the position profile of Fig. 4 shows a specific pattern with lines 201, 202, 203, 204, 205, 206 that is repeated for each peg 210.
  • the display is preferably 3D, so that the (virtual) pegs could be aligned in a line in the depth on the screen and the nine holes 220 are arranged in a 3x3 array on the 3D board plane 200. The subject displaces this handle 15 or 25 attached to the haptic device.
  • the Virtual Peg Insertion Test uses a haptic interface 60 to render physical interactions with the environment (e.g. board 200, pegs 210 and holes 220) while it records kinetic and kinematic data.
  • the movement of transfer of a peg 210 into a hole 220 on the screen and return to fetch a new peg 210 can be decomposed into six sequences as follows: approach of the cursor to the peg for alignment and grasping 201, reaction phase once the peg is grasped 202, coarse displacement up to a hole 203, approach of a hole to insert the peg 204, reaction phase after insertion 205 and coarse displacement to the next peg 206, wherein the different phases are separated by short lines crossing the two adjacent sequences.
  • the execution time T ⁇ is the time to execute the task from the approach of the first peg 210 to the insertion of the last peg 210.
  • the grasping force is calculated from the mean of the three force sensors integrated into the handle 15 or 25.
  • the average grasping force F g is calculated during the coarse displacement 203 and 206, giving one value for the transport of a peg 210 and another value for the return.
  • the trajectory error E t n y corresponds to the distance between the trajectory and the straight line in the horizontal plane normalized by the trajectory length during displacement (go/return).
  • the mean collision force F cmean represents the averaged force exerted against the board 200 during the task from the approach of the first peg 210 to the insertion of the last peg 210.
  • the collision force is estimated from the motor currents required to render the haptic feedback during the collision with the board 200.
  • ANOVA analysis of variance
  • the performance parameters of the two groups of healthy subjects were first compared in order to determine if the performance significantly changed when the task was performed with the dominant versus the non-dominant hand. For each parameter, the mean values and the standard deviation for all subjects and all trials were calculated. The results of this analysis are presented in the following Table, showing performance parameters of subjects performing the task with the dominant versus the non-dominant hand and significant differences between the two groups (left), performance of four stroke subjects performing the task with the impaired hand (right), hand dominance is indicated as "d” for dominant and "nd" for non-dominant.
  • Fig. 5 shows the trajectories 208 and 209 of a representative healthy subject and a stroke subject (SI) during the execution of a complete trial of the Virtual Peg Insertion Test.
  • the trajectories 208 or 209 are divided into the different task sequences: approach of a peg, reaction after taking a peg, coarse displacement during the transport of a peg, approach of a hole, reaction after inserting a peg in a hole and coarse displacement during the return according to Fig. 4.
  • performance of the stroke and the healthy subjects were compared in order to evaluate the parameters analyzed to be used as indicators of arm and hand impairment. Representative trajectories of a healthy subject and a stroke subject during one complete trial are presented.
  • Fig. 6 shows the grasping force in function of time of a healthy subject and a stroke subject (SI) during the execution of a complete trial of the Virtual Peg Insertion Test.
  • the force threshold was set to 5 N as is indicated by the horizontal dotted line. Movement sequences are indicated as follows: approach 201 and 204. reaction 202 and 205, displacement 203 and 206 as explained in connection with Fig. 4.
  • the grasping force applied by the healthy subject on the handle clearly showed a repetitive pattern for the nine pegs 210. Healthy subjects tended to apply a strong force to initially grasp the peg 210 and slowly decreased the force during the transport of the peg 210.
  • the mean grasping force applied by healthy subjects during the transport of a peg 210 was much larger than the threshold to hold the peg 210.
  • the force profile of stroke subjects showed that they often needed several attempts to grasp the peg 210, represented by the peaks in Fig. 6. This was due to the application of force without proper alignment of the cursor with the peg 210. Additionally, the maximal forces applied on the handle by the stroke subject after taking a peg 210 were much smaller and the mean grasping force during the transport of a peg 210 was only slightly above the threshold of 5 N.
  • the mean values of all the trials were calculated for each stroke subject and are presented in the above represented table.
  • the values differ from the healthy subjects for at least one stroke subject except for the grasping force during the return trajectory.
  • the grasping force during the go trajectory tended to be lower for the stroke subjects while the execution time, the number of zero-crossings of the acceleration, the number of dropped pegs and the trajectory error tended to be higher.
  • Two of the four stroke subjects suffered from sensory deficits and showed higher mean collision forces while the two other subjects showed normal values.
  • the execution time seems to vary with the severity of the impairment for the first three subjects with S2 (A3) being faster than SI and S3 (A2).
  • S4 (A3) was slower, which could indicate that hand sensory deficits also have an influence on the execution time.
  • Grasping force could provide information on muscle strength and joint coordination.
  • the grasping force profiles showed that stroke subjects applied less force during this kind of functional task, and the presence of several peaks during the approach of a peg indicated that they had difficulties in coordinating the position adjustment and control of force. Fine precision adjustments have been shown to be characteristic of stroke subjects. In the contrary, healthy subjects applied high forces, possibly with the aim of stabilizing their grip during peg transfer and maximizing their movement speed.
  • Fig. 7 shows a flowchart of the method of a virtual peg test according to the invention.
  • the subject in question executes the displacement 305 of one peg 210 into one hole 220.
  • the relevant data are recorded 310 in a first step, kinetic and kinematic data are collected with the neurologically impaired patient during well- controlled motor tasks involving hand, wrist and arm function (e.g. precise alignment grasping and manipulation of the pegs).
  • This first step comprises the test 315, if the test is completed, i.e. all nine pegs 210 lodged in the corresponding holes 220.
  • a set of motor performance indicators for example the time required to complete a task, or the precision of a movement, will be extracted 320 from the kinetic and kinematic data.
  • Said date can refer to zero crossing of acceleration, the execution time, the value of the collision force with the virtual board 200, the grasping force(s) and the trajectory error / hand path ratio, i.e. the deviation from a straight or directed movement.
  • hand and arm impairment will be derived 325 from a model based on a combination of the performance parameters. It is essential to properly distinguish between impairment and performance since performance does not necessarily reflect the impairment, e.g. if patient uses compensatory strategies during the execution of a task. Impairment is defined here as the result of a disability, which has a direct consequence on what a patient can or cannot do with his her arm and hand, while performance is defined here as how well one achieves a specific task. Such features can be calculated for tremor within the data, precision of the approach, the sensory perception, the related muscle strength and the inter-joint coordination.
  • an assessment scale 330 based on the subject's impairment is applied and can be compared to established clinical scales to help therapist select appropriate therapy for their patients, thus comprising scores, predicted clinical scores and the visual representation as in Fig. 5 and 6 for evaluation.
  • handle 202 reaction on peg grasping two-portion handle 203 coarse displacement to hole,22 pretension screws 204 approach of hole
  • IMU 206 coarse displacement to peg further sensor 208 trajectory of a stroke subject, 46 supply and data lines 209 trajectory of a healthy subject data acquisition card 210 virtual peg

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Physics & Mathematics (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Physiology (AREA)
  • Dentistry (AREA)
  • Physical Education & Sports Medicine (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un dispositif d'acquisition de données (10) représentant un objet virtuel et conçu pour être fixé à un dispositif de détection de position (60), lequel dispositif d'acquisition de données comprend une poignée (5) ayant au moins un capteur (121, 122, 123) permettant à un utilisateur du dispositif (10) d'émettre un signal de manipulation du dispositif d'acquisition de données (10). La poignée (5) comprend au moins deux surfaces actives (110) conçues pour être poussées dans la direction du corps de la poignée (5). Au moins un capteur de force (121, 122, 123) est associé à chacune desdites surfaces actives (110) conçu pour détecter une force de poussée de la saisie et/ou de la pression par l'utilisateur de la poignée par l'intermédiaire des surfaces actives (110).
PCT/EP2012/002676 2011-06-27 2012-06-25 Dispositif d'acquisition de données représentant un objet virtuel WO2013000559A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP11005192A EP2540226A1 (fr) 2011-06-27 2011-06-27 Dispositif d'acquisition de données représentant un objet virtuel
CH1082/11 2011-06-27
CH10822011 2011-06-27
EP11005192.7 2011-06-27

Publications (1)

Publication Number Publication Date
WO2013000559A1 true WO2013000559A1 (fr) 2013-01-03

Family

ID=46397148

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2012/002676 WO2013000559A1 (fr) 2011-06-27 2012-06-25 Dispositif d'acquisition de données représentant un objet virtuel

Country Status (1)

Country Link
WO (1) WO2013000559A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015202341A (ja) * 2014-04-16 2015-11-16 日本光電工業株式会社 リハビリテーション支援システム
CN105380659A (zh) * 2015-11-24 2016-03-09 哈尔滨工业大学 人手或假手抓取能力评估系统和评估方法
WO2019208274A1 (fr) * 2018-04-23 2019-10-31 株式会社シロク Système d'évaluation de fonction cognitive

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4035865A (en) * 1976-01-19 1977-07-19 Mcrae Lucy Theresa Implements usable by persons afflicted with arthritis
WO2005043365A2 (fr) 2003-10-30 2005-05-12 Sensable Technologies, Inc. Interface haptique refletant la force
US20080161733A1 (en) * 2004-02-05 2008-07-03 Motorika Limited Methods and Apparatuses for Rehabilitation and Training
JP2010057629A (ja) 2008-09-02 2010-03-18 National Univ Corp Shizuoka Univ 自立体力テスト方法及びその装置
WO2011036350A1 (fr) 2008-09-22 2011-03-31 Universite De Technologie De Troyes Dispositif d'évaluation et/ou de renforcement de la force de préhension

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4035865A (en) * 1976-01-19 1977-07-19 Mcrae Lucy Theresa Implements usable by persons afflicted with arthritis
WO2005043365A2 (fr) 2003-10-30 2005-05-12 Sensable Technologies, Inc. Interface haptique refletant la force
US20080161733A1 (en) * 2004-02-05 2008-07-03 Motorika Limited Methods and Apparatuses for Rehabilitation and Training
JP2010057629A (ja) 2008-09-02 2010-03-18 National Univ Corp Shizuoka Univ 自立体力テスト方法及びその装置
WO2011036350A1 (fr) 2008-09-22 2011-03-31 Universite De Technologie De Troyes Dispositif d'évaluation et/ou de renforcement de la force de préhension

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
B. ROHRER ET AL.: "Movement smoothness changes during stroke recovery", J.NEUROSCI., vol. 22, no. 18, September 2002 (2002-09-01), pages 8297 - 8304
J.P.DENVWALD; R.F. BEER: "Abnormal joint torque pattern in the paretic upper limb of subjects with hemiparesis", MUSCLE NERVE, vol. 24, no. 2, February 2001 (2001-02-01), pages 273 - 283
JANEZ PODOBNIK ET AL: "Comparison of grip action triggered by haptic or visual cue", REHABILITATION ROBOTICS, 2007. ICORR 2007. IEEE 10TH INTERNATIONAL CON FERENCE ON, IEEE, PI, 1 June 2007 (2007-06-01), pages 75 - 80, XP031200695, ISBN: 978-1-4244-1319-5 *
JANEZ PODOBNIK ET AL: "Robot-assisted evaluation of coordination between grasp and load forces in a power grasp in humans", ADVANCED ROBOTICS, vol. 20, no. 8, 1 August 2006 (2006-08-01), pages 933 - 951, XP055012239, ISSN: 0169-1864, DOI: 10.1163/156855306777951447 *
LAMBERCY O ET AL: "A Haptic Knob for Rehabilitation of Hand Function", IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATIONENGINEERING, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 15, no. 3, 1 September 2007 (2007-09-01), pages 356 - 366, XP011192080, ISSN: 1534-4320, DOI: 10.1109/TNSRE.2007.903913 *
MARIE-CHRISTINE FLUET ET AL: "Upper limb assessment using a Virtual Peg Insertion Test", REHABILITATION ROBOTICS (ICORR), 2011 IEEE INTERNATIONAL CONFERENCE ON, IEEE, 29 June 2011 (2011-06-29), pages 1 - 6, XP031924232, ISBN: 978-1-4244-9863-5, DOI: 10.1109/ICORR.2011.5975348 *
P FEYS ET AL.: "Arm training in multiple sclerosis using phantom: clinical relevance of robotic outcome measures", PROC. IEEE INTERNATIONAL CONFERENCE ON REHABILITATION ROBOTICS, 2009, pages 576 - 581, XP031516461
R MCGORRY: "A system for the measurement of grip forces and applied moments during hand tool use", APPLIED ERGONOMICS, vol. 32, no. 3, 1 June 2001 (2001-06-01), pages 271 - 279, XP055012240, ISSN: 0003-6870, DOI: 10.1016/S0003-6870(00)00062-4 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015202341A (ja) * 2014-04-16 2015-11-16 日本光電工業株式会社 リハビリテーション支援システム
CN105380659A (zh) * 2015-11-24 2016-03-09 哈尔滨工业大学 人手或假手抓取能力评估系统和评估方法
CN105380659B (zh) * 2015-11-24 2018-06-22 哈尔滨工业大学 人手或假手抓取能力评估系统和评估方法
WO2019208274A1 (fr) * 2018-04-23 2019-10-31 株式会社シロク Système d'évaluation de fonction cognitive
JP2019187682A (ja) * 2018-04-23 2019-10-31 株式会社シロク 認知機能評価装置
JP7126851B2 (ja) 2018-04-23 2022-08-29 株式会社ニューコム 認知機能評価装置

Similar Documents

Publication Publication Date Title
Baldi et al. GESTO: A glove for enhanced sensing and touching based on inertial and magnetic sensors for hand tracking and cutaneous feedback
Chang et al. Towards pervasive physical rehabilitation using Microsoft Kinect
Fluet et al. Upper limb assessment using a virtual peg insertion test
Brewer et al. Poststroke upper extremity rehabilitation: a review of robotic systems and clinical results
Lederman et al. Sensing and displaying spatially distributed fingertip forces in haptic interfaces for teleoperator and virtual environment systems
US20120077163A1 (en) 3d monocular visual tracking therapy system for the rehabilitation of human upper limbs
Cameirão et al. Virtual reality based upper extremity rehabilitation following stroke: a review
EP2923683A1 (fr) Dispositif interactif de réhabilitation, surveillance et/ou évaluation des membres supérieurs
EP2540226A1 (fr) Dispositif d'acquisition de données représentant un objet virtuel
WO2013000559A1 (fr) Dispositif d'acquisition de données représentant un objet virtuel
TWI509556B (zh) Goal - oriented Rehabilitation Auxiliary System and Its Work Setting Method
Alamri et al. Haptic exercises for measuring improvement of post-stroke rehabilitation patients
Fazeli et al. A virtual environment for hand motion analysis
Kolsanov et al. Augmented Reality application for hand motor skills rehabilitation
Chuang et al. A virtual reality-based system for hand function analysis
Feix et al. Effect of number of digits on human precision manipulation workspaces
Hammond et al. Objective evaluation of fine motor manipulation—a new clinical tool
US20060293615A1 (en) Device and method for quantifying and extracting sensorimotor circuitry
Emery et al. Haptic/VR assessment tool for fine motor control
Samra et al. Design of a tactile instrument to measure human roughness perception in a virtual environment
TW476643B (en) Exercise control glove for diagnostic evaluation and rehabilitation of palm and system device thereof
Lim et al. Weight Perception Simulation in Virtual Reality with Passive Force using Force Sensing Resistors
Ahmmad et al. Experimental study of surgeon's psychomotor skill using sensor-based measurement
Bethi Exergames for telerehabilitation
Wang et al. A novel design of a wearable device for measuring force and torque in vascular surgery

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12730392

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12730392

Country of ref document: EP

Kind code of ref document: A1

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载