CN100428265C - A method for scanning business cards with a mobile phone with a digital camera - Google Patents

Abstract

A method for scanning a business card with a mobile phone with a digital camera, which belongs to the technical field of mobile phone applications. The method uses the mobile phone to directly add useful information such as name and address contained in the business card to the address book of the mobile phone , including the steps of photographing the business card with a mobile phone: detecting the four sides of the business card to be photographed on the screen of the mobile phone, and drawing the detected four sides of the business card to be photographed with lines of one color, so that the mobile phone user can clearly see the position of the business card on the screen location and shape, and according to the current position of the business card, the mobile phone user is prompted to move the business card along the direction indicated by the arrow until the business card enters a position suitable for shooting; when the business card is in a position suitable for shooting, the four sides of the business card become the first The two colors remind mobile phone users that they are ready for shooting; mobile phone users only need to hold the mobile phone firmly, and manually or automatically activate the "shoot" button to complete the shooting of the business card to be photographed, thus overcoming the disadvantages of the camera shaking easily during shooting.

Description

A method for scanning business cards with a mobile phone with a digital camera

technical field

The invention relates to a method for scanning business cards with a mobile phone with a digital camera, which belongs to the technical field of mobile phone applications.

Background technique

Currently, digital cameras in mobile phones are becoming more and more popular, and the resolution of digital cameras is getting higher and higher. This creates conditions for the mobile phone with a digital camera to scan business cards.

Business card scanning technology refers to the technology of using a mobile phone with a digital camera to directly add useful information such as name, address, zip code, telephone number, fax number, and e-mail address contained in the business card to the address book of the mobile phone. Compared with the traditional method of using a scanner to scan business cards, the biggest advantage of this technology is that the above-mentioned task of adding useful information can be realized by a mobile phone and its own digital camera, without the need for an additional scanner. The realization of this technology needs to complete the following four steps: (1) take the image of the business card with the digital camera that comes with the mobile phone; (2) use OCR (optical character recognition, optical character recognition) technology to automatically recognize the business card captured in step (1) (3) Use text classification technology to automatically find useful information such as name, address, zip code, telephone number, fax number, email address and the like in the text recognized in (2) step, and use them as The recognition result is displayed on the screen of the mobile phone; (4) the mobile phone user checks the recognition result, and after correction and confirmation, the mobile phone automatically adds the confirmed recognition result to the address book of the mobile phone. This technology can quickly enter the business card information into the address book, saving the trouble and inconvenience of manual input. Among the above four steps, (2), (3) and (4) are mature prior art, and there is no difficulty in implementing them. The task of step (1) is to take a complete, large and clear business card image with the digital camera carried by the mobile phone. Unlike scanning business cards with a scanner, step (1) requires mobile phone users to participate in the shooting operation to complete, and most mobile phone users do not have photography skills, so the final captured business card images often contain a lot of "noise", such as projection distortion, The content is incomplete, the picture is too small or the image is blurred, etc., as shown in Figure 1(b), Figure 1(c) and Figure 2, which seriously affect the quality of the captured business card image, thereby seriously affecting the recognition rate of business card scanning. As a result, there are many errors in the text automatically recognized by OCR technology and in useful information such as names found by text classification technology, which makes the business card scanning technology that can be realized by using mobile phones and their own digital cameras lose. its practicality.

The following are some prior art attempts to solve the problems in step (1).

United States Patent Application 20030133703 filed by Lin-Chen Yu et al. describes a device for holding mobile phones and business cards. The mobile phone and the business card are fixed on the device, and when the digital camera attached to the mobile phone is used to shoot the business card, it can be ensured that the captured business card image will not have projection deformation and the camera will not shake when shooting. The disadvantage of this technology is that it requires mobile phone users to carry an additional device that is not highly utilized. As mentioned above, the digital camera that comes with the mobile phone does not need additional devices to realize business card scanning. This technology makes the mobile phone with a digital camera lose its advantage in realizing business card scanning.

Many commercially available mobile phones with high-resolution digital cameras have a business card scanning function, one of which is Motorola's "Ming" brand mobile phone. This mobile phone adopts another method to take business cards: draw three red lines at specific positions on the screen of the mobile phone, prompting the mobile phone user when taking business cards, the three sides of the business card should coincide with the three red lines. When the three sides of the business card roughly overlap with the three red lines, the red lines become green lines, and the digital camera of the mobile phone enters a countdown period, and when the countdown period ends, the digital camera of the mobile phone automatically takes pictures of the business card. The disadvantage of this technology is that when the digital camera of the mobile phone is used to take a business card, there is relative motion between the digital camera and the business card, and the image on the screen of the mobile phone is constantly changing. Don't know how to move the card so that it coincides with the three red lines mentioned.

Contents of the invention

The purpose of the invention is to introduce a method for scanning business cards with a mobile phone with a digital camera. The method is implemented in a mobile phone with a digital camera, which has a business card scanning function, but does not have the disadvantages of the background technology.

In order to achieve the above object, the present invention adopts the following technical solutions. On the basis of steps (2), (3) and (4) of the above-mentioned background technology, step (1) is improved: detect the four sides of the business card to be photographed on the screen of the mobile phone, and use the color of the first color Draw the detected four sides of the business card to be photographed, so that the mobile phone user can clearly see the position and shape of the business card on the screen, and prompt the mobile phone user to move the business card to be photographed in the direction indicated by the arrow according to the current position of the business card to the business card Enter a position suitable for shooting; when the relative position of the digital camera of the mobile phone and the business card is suitable for shooting, the four sides of the business card will change to the second color, prompting the mobile phone user to be ready for shooting; the mobile phone user only needs to hold the mobile phone firmly , manual or mobile phone automatically activate the "shooting" button of the digital camera to complete the shooting of the business card to be shot, thus overcoming the disadvantage that the camera is prone to shake when shooting.

The technical solution of the present invention will now be described in detail in conjunction with the accompanying drawings. The solution includes seven steps, of which the first, third and fourth steps are shown in Figures 4, 5 and 6 respectively.

A method for scanning a business card with a mobile phone with a digital camera, comprising four steps: (1) taking an image of the business card to be photographed with the digital camera attached to the mobile phone; (2) using OCR technology to automatically identify (3) use text classification technology to automatically find useful information in the text identified in (2) step, the useful information is name, address, zip code, telephone number, fax number, electronic email address, and display them as the identification result on the screen of the mobile phone; (4) the mobile phone user checks the identification result, and after correcting and confirming, the mobile phone will automatically add the confirmed identification result to the mobile phone In the address book, the method needs to be carried out in a mobile phone with a digital camera. In the mobile phone, there are a shooting system and a business card recognition system containing a single-chip system, and the following programs are stored in the memory of the single-chip system. and instructing the CPU to perform the following operations to ensure that the method can be carried out normally: the image of the business card to be photographed is displayed on the screen, the corners are displayed on the screen, the edge of the business card to be photographed is determined, and a line is drawn with the first color, Draw an arrow with the first color to determine the coincidence of the vertex and the corner point of the angle of the business card to be photographed, draw a line with the second color, and start the "shooting" button. It is characterized in that, in (1) step, the mobile phone The shooting system in the camera takes the image of the business card to be taken according to the following steps:

In the first step, the lens of the digital camera carried by the mobile phone is aimed at the business card to be photographed, and the image of the business card to be photographed is displayed on the screen of the mobile phone by the described shooting system, and displayed on the screen The four corners are displayed near the four corners of the mobile phone, reminding the mobile phone user that when the business card to be photographed is in a suitable shooting position, the vertices of the four corners of the business card to be photographed should coincide with the four corners respectively;

In the second step, the four sides of the business card to be photographed are automatically detected by the described photographing system;

In the third step, draw the four sides of the business card to be photographed detected in the second step on the screen with lines of the first color, and indicate the direction in which the business card to be photographed should move with the indicating arrow of the first color;

In the fourth step, the photographing system checks whether the business card to be photographed is in a suitable photographing position, if not, returns and executes the second step, if so, draws the line of the business card to be photographed on the screen with a line of the second color The four sides remind the mobile phone user that the business card to be photographed is in a suitable position for photographing and can be photographed. Enter and execute the fifth step;

The fifth step, the mobile phone user judges the shooting settings of the mobile phone, if it is "manual shooting", enter and execute the sixth step, if it is "automatic shooting", enter and execute the seventh step;

In the sixth step, the mobile phone user holds the mobile phone firmly, presses the "shoot" button of the mobile phone, and obtains the image of the business card to be photographed;

In the seventh step, the shooting system automatically activates the "shooting" button of the mobile phone to obtain the image of the business card to be shot.

The technical solution of the present invention is further characterized in that in the third step, the first color is red, and in the fourth step, the second color is green.

The technical solution of the present invention is further characterized in that, when each step is executed, the photographing system displays instruction sentences to guide the mobile phone user to operate correctly on the screen.

The method of the present invention is particularly suitable for taking images of business cards to be shot in mobile phones with digital cameras, and also in mobile devices with cameras.

Compared with background technology, the present invention has the following advantages:

1. Guide mobile phone users to capture high-quality images of business cards to be captured through screen prompts.

By detecting the four sides of the business card to be photographed on the screen, the mobile phone user can clearly see the current position and shape of the business card to be photographed, and the prompt arrow can let the mobile phone user clearly know how to move the business card to be photographed to take pictures to a qualified image. Through the prompts on the screen, guide any mobile phone user who does not have photography skills to capture high-quality images of business cards to be photographed.

2. The automatic shooting function enables the camera of the mobile phone to take pictures of the business cards to be taken without shaking, which helps to improve the quality of the pictures of the business cards to be taken.

The above two advantages ensure that the mobile phone can capture high-quality images of business cards without any "noise", thereby ensuring the recognition accuracy of the business card recognition system and improving the performance of the business card recognition system. Usability and ease of use.

Description of drawings

Fig. 1(a) and Fig. 1(b) are the schematic diagrams of projected deformation with small and projected deformation respectively.

Fig. 2 shows a schematic diagram of a blurred image of a business card to be photographed caused by camera shake.

Fig. 3 is a flowchart of the operation of the method of the present invention.

Fig. 4 is one of the screen displays of the screen of the mobile phone, where the four red right angles are four corner points respectively.

Fig. 5 is the second screen display of the screen of the mobile phone, wherein the four red lines are the four sides of the business card to be photographed, and the red prompt arrows indicate the direction in which the business card to be photographed needs to be moved.

Fig. 6 is the third screen display of the screen of the mobile phone, wherein the four green lines are the four sides of the business card to be photographed, the four green right angles are the four corners, and the four sides and the four corners change from red to green , indicating that the business card to be photographed is in a suitable position for photographing.

Detailed ways

Example 1

This embodiment is fully carried out in a mobile phone with a digital camera having the following technical indicators according to the method described in the "Summary of the Invention":

Mobile phone brand: dopod (Dopod) 830;

Digital camera resolution: 2Mpix.;

CPU operating frequency: 195MHz;

Memory capacity in the single-chip microcomputer system: 44Mbit;

Screen diagonal length: 2.8in.;

Screen resolution: 320*240pix.;

Mobile phone operating system: Microsoft's windows mobile 5.0.

Example 2

This embodiment is identical to Embodiment 1 except for the following differences: in the third step, the first color is red, and in the fourth step, the second color is green.

Example 3

This embodiment is identical to Embodiment 2 except for the following differences: when each step is executed, the photographing system displays instructions to guide the mobile phone user to operate correctly on the screen.

Claims (8)

1. A method for scanning a business card with a mobile phone with a digital camera, comprising four steps: (1) taking an image of the business card to be taken with the digital camera carried by the mobile phone; (2) automatically identifying the (1) step with OCR technology Capture the text in the business card image to be photographed; (3) use text classification technology to automatically find out the useful information in the text identified in (2) step, and the useful information is name, address, zip code, telephone number, fax number , email address, and display them as the identification result on the screen of the mobile phone; (4) the mobile phone user checks the identification result, and after correcting and confirming, the mobile phone will automatically add the confirmed identification result to the described mobile phone. In the address book of the mobile phone, this method needs to be carried out in the mobile phone with digital camera, and in described mobile phone, there are photographing system and business card recognition system containing single-chip microcomputer system, and the following program is stored in the memory of described single-chip microcomputer system , control and direct the CPU to perform the following operations to ensure that the method can be implemented normally: the image of the business card to be photographed is displayed on the screen, the corner points are displayed on the screen, the edge of the business card to be photographed is determined, and the first color is used to draw Line, draw an arrow with the first color, determine the coincidence of the vertex and the corner point of the angle of the business card to be photographed, draw the line with the second color, start the "shooting" button, it is characterized in that, in (1) step, the The shooting system in the mobile phone takes the image of the business card to be shot according to the following steps: In the first step, the lens of the digital camera carried by the mobile phone is aimed at the business card to be photographed, and the image of the business card to be photographed is displayed on the screen of the mobile phone by the described shooting system, and displayed on the screen The four corners are displayed near the four corners of the mobile phone, reminding the mobile phone user that when the business card to be photographed is in a suitable shooting position, the vertices of the four corners of the business card to be photographed should coincide with the four corners respectively; In the second step, the four sides of the business card to be photographed are automatically detected by the described photographing system; In the third step, draw the four sides of the business card to be photographed detected in the second step on the screen with lines of the first color, and indicate the direction in which the business card to be photographed should move with the indicating arrow of the first color; In the fourth step, the photographing system checks whether the business card to be photographed is in a suitable photographing position, if not, returns and executes the second step, if so, draws the line of the business card to be photographed on the screen with a line of the second color The four sides remind the mobile phone user that the business card to be photographed is in a suitable position for photographing and can be photographed. Enter and execute the fifth step; The fifth step, the mobile phone user judges the shooting settings of the mobile phone, if it is "manual shooting", enter and execute the sixth step, if it is "automatic shooting", enter and execute the seventh step; In the sixth step, the mobile phone user holds the mobile phone firmly, presses the "shoot" button of the mobile phone, and obtains the image of the business card to be photographed; In the seventh step, the shooting system automatically activates the "shooting" button of the mobile phone to obtain the image of the business card to be shot. 2. The method for scanning business cards with a mobile phone with a digital camera according to claim 1, wherein in the third step, the first color is red, and in the fourth step, the second color is green. 3. The method for scanning business cards with a mobile phone with a digital camera according to claim 1, characterized in that, when each step is executed, the photographing system displays instruction sentences to guide the mobile phone user to operate correctly on the screen. 4. The method for scanning business cards with a mobile phone with a digital camera according to claim 1, wherein the method is implemented in a mobile phone with a digital camera having the following technical indicators: Mobile phone brand: Dopod 830; Digital camera resolution: 2Mpix.; CPU operating frequency: 195MHz; Memory capacity in the single-chip microcomputer system: 44Mbit; Screen diagonal length: 2.8in.; Screen resolution: 320*240pix.; Mobile phone operating system: Microsoft's windows mobile 5.0. 5. The method for scanning business cards with a mobile phone with a digital camera according to claim 1, wherein in the third step, the first color is red, in the fourth step, the second color is green, and in the fourth step, the second color is green. When each step is executed, the shooting system displays instruction sentences to guide the mobile phone user to operate correctly on the screen. 6. The method for scanning business cards with a mobile phone with a digital camera according to claim 1, characterized in that in the third step, the first color is red, in the fourth step, the second color is green, the The method is implemented in a mobile phone with a digital camera having the following technical indicators: Mobile phone brand: Dopod 830; Digital camera resolution: 2Mpix.; CPU operating frequency: 195MHz; Memory capacity in the single-chip microcomputer system: 44Mbit; Screen diagonal length: 2.8in.; Screen resolution: 320*240pix.; Mobile phone operating system: Microsoft's windows mobile 5.0. 7. The method for scanning business cards with a mobile phone with a digital camera according to claim 1, characterized in that, when each step is executed, the photographing system displays instruction sentences to guide the mobile phone user to operate correctly on the screen, the method is implemented in a mobile phone with a digital camera having the following technical indicators: Mobile phone brand: Dopod 830; Digital camera resolution: 2Mpix.; CPU operating frequency: 195MHz; Memory capacity in the single-chip microcomputer system: 44Mbit; Screen diagonal length: 2.8in.; Screen resolution: 320*240pix.; Mobile phone operating system: Microsoft's windows mobile 5.0. 8. The method for scanning business cards with a mobile phone with a digital camera according to claim 1, wherein in the third step, the first color is red, in the fourth step, the second color is green, and in the fourth step, the second color is green. When carrying out each step, described photographing system is displayed on the described screen the instruction sentence that instructs mobile phone user to operate correctly, and this method is carried out in the mobile phone with digital camera that has following technical index: Mobile phone brand: Dopod 830; Digital camera resolution: 2Mpix.; CPU operating frequency: 195MHz; Memory capacity in the single-chip microcomputer system: 44Mbit; Screen diagonal length: 2.8in.; Screen resolution: 320*240pix.; Mobile phone operating system: Microsoft's windows mobile 5.0.

Images