JP2000107440A - Game device, game system, network system, and information recording medium - Google Patents

Abstract

(57) [Problem] To provide a game device, a game system, and an information recording medium in which it is difficult for a game player to recognize the timing of thinning out or supplementing game image and audio information. SOLUTION: A transmission / reception unit 236 for receiving game data from a game data distribution device 100, a decompression unit 244 for decompressing the received game data, and an image display unit 2 for reproduction.
20, a data amount monitoring unit 242 for monitoring a change in the received game data amount in a compressed state, and a data amount calculating unit 2 for calculating the received game data amount in a compressed state
41, and a game device 200 including a data adjustment unit 239 for thinning out or supplementing the received game data based on the monitored result and the calculated result.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a game device, a game system, a network system, and an information recording medium.

[0002]

2. Description of the Related Art When an image generating means and an image displaying means are operated by different clock sources, even if the clock generating sources operating at the same frequency are used, the operations of the two are performed. Timing may be different.

[0003] In particular, when the image generating means and the image display means are connected via a network, the use environments of the two are different, so that there is often a slight shift between the two during the actual operation.

In such a case, since the timing of image generation and the timing of image display gradually shift, it is necessary to adjust somewhere.

[0005] For example, when an image generated by the image display means of the host is displayed on the display means of the terminal via the network, there is a slight shift between the operation clocks of the image generation means and the image display means, and the image generation is not performed. The timing and the timing of image display gradually shift, and the difference between the two timings increases.

Further, even when there are a plurality of terminals using the same image display means, the exact operating clock often differs depending on the image display means depending on the installation environment of each terminal. May be different for each terminal.

In such a situation, in order to synchronize among a plurality of processing devices, a data receiving side processing device thins out or supplements data in a buffer and synchronizes with other processing devices.

Conventionally, when data is transmitted, at a critical point immediately before an overflow or an underflow occurs in a buffer on the receiving side, data is decimated, that is, part of the data is deleted, or data is supplemented, that is, the data is deleted. Was partially replenished.

However, in this method, the continuity of the data in the buffer is lost before and after the thinning and the filling are performed. For this reason, if these processes are performed on video data or continuous audio data, the screen may look tight,
In some cases, the observer may feel uncomfortable, such as mixing noise.

In particular, in a network-type game system, it is necessary to synchronize between game devices. In such a case, if the timing of synchronization adjustment is known to the game player, the game player You will not be able to concentrate on

An object of the present invention is to provide a network system in which continuous data such as moving image data or continuous audio data is transmitted, and even when the receiving side reproduces the data in synchronization with the transmitting side, it is difficult for an observer to recognize the timing of thinning or compensation. And an information recording medium.

Another object of the present invention is to transmit continuous data such as game image data and game sound data,
It is an object of the present invention to provide a game device, a game system, and an information recording medium in which it is difficult for a game player to recognize the timing of thinning or supplementing even when reproduction is performed in synchronization with a transmission side on a reception side.

[0013]

According to a first aspect of the present invention, there is provided a game system which receives operation data of a game player and transmits distribution request data generated based on the operation data. A game data distribution device that generates and compresses game data including at least one of game image data and game sound data based on distribution request data transmitted from the game device and transmitted through the network, and distributes the game data to the game device; A game data distribution device, wherein the game data distribution device receives distribution request data from the game device, generates game data based on the received distribution request data, and generates the game data. Means for compressing and transmitting the compressed information to the game device,
The game device generates the distribution request data based on operation data input by a game player, transmits the data to the game data distribution device, and receives the game data from the game data distribution device. Means for expanding and reproducing game data, means for monitoring a change in the amount of received game data in a compressed state,
Calculating means for calculating the received game data amount in a compressed state, and adjusting means for thinning out or supplementing the received game data based on the monitored result and the calculated result. I do.

In the conventional method, thinning or supplementation is performed at a stage where game data adjustment is required, for example, at a critical point in the buffer. For this reason, a change in game data may cause the game player to know the timing of thinning or compensation, and may not be able to concentrate on the game.

According to the present invention, thinning and / or compensation can be performed in a state where the adjustment of game data is inconspicuous even if the game data is adjusted based on the monitoring result and the calculation result of the data amount. Thereby, the game player can concentrate on playing the game.

Here, the term "thinning-out" refers to processing data subsequent to the data to be processed next, instead of the data to be processed next, and "supplementation" refers to processing the previously processed data again. Say.

Further, according to the present invention, the game device can be synchronized with the game data distribution device without noticing the game player.

According to a second aspect of the present invention, in the first aspect, the adjustment means reduces or supplements the game data when the change in the game data amount is larger than a predetermined value as a result of the monitoring. It is characterized by performing.

According to the present invention, the game data can be adjusted without being noticed by the game player by thinning out or supplementing the game data when the change in the game data amount is larger than the predetermined value.

Here, when the change in the amount of game data is larger than a predetermined value, for example, when the luminance changes sharply in a flash scene or the like, a still image from a moving image, a moving image from a still image, and a part from the whole image are used. The case of switching an image such as an up image, the case of switching sound such as a noise sound, and the like correspond.

Further, the invention according to claim 3 is based on claim 1,
2. In any one of the above items 2, the adjustment means performs thinning or supplementation of the game data when there is almost no change in the game data amount as a result of the monitoring.

According to the present invention, by thinning out or supplementing the game data when the amount of the game data hardly changes, the game data can be adjusted without being noticed by the game player.

Here, the case where the amount of game data hardly changes corresponds to, for example, a state in which still images are continuous, a silent state, or the like.

Further, the invention according to claim 4 is the same as the invention according to claim 1.
3. In any one of 3., further comprising a storage unit having a predetermined storage area for storing the received game data,
The calculating means calculates a ratio of the game data amount occupying the storage area, and the adjusting means determines that the difference between the calculated ratio and a desired ratio is larger than a predetermined value. It is characterized by thinning out or supplementing data.

According to the present invention, when the difference between the calculated ratio and the desired ratio is larger than a predetermined value, the game data is thinned or supplemented to adjust the game data without being noticed by the game player. it can.

Here, the case where the difference between the calculated ratio and the desired ratio is larger than a predetermined value includes the case where the calculated ratio exceeds the desired ratio and the case where the calculated ratio becomes the desired ratio. Both cases are less.

According to a fifth aspect of the present invention, there is provided a game device wherein the game player inputs distribution request data, and transmits the input distribution request data to the game data distribution device via a network, and outputs the game image data. Means for receiving game data including at least one of game data and game sound data; means for expanding and reproducing the received game data; monitoring means for monitoring a change in the received game data amount in a compressed state; Computing means for computing the received game data amount in a state, and adjusting means for thinning out or supplementing the received game data based on the monitored result and the computed result. .

According to the present invention, thinning and / or compensation can be performed in a state that is inconspicuous even if game data is adjusted based on the data amount monitoring result and the calculation result. Thereby, the game player can concentrate on playing the game.

Here, the term "thinning-out" refers to processing data after the data in place of the data to be processed next, and "supplementation" refers to processing the previously processed data again. Say.

Further, according to the present invention, it is possible to synchronize the game device and the game data distribution device without noticing the game player.

According to a sixth aspect of the present invention, in the fifth aspect, as a result of the monitoring, if the change in the game data amount is larger than a predetermined value or the change in the game data amount hardly occurs, In this case, the received game data is thinned out or supplemented.

According to the present invention, when the change in the game data amount is larger than a predetermined value or when the game data amount hardly changes, the game data is thinned out or supplemented so that the game player does not notice it. Data adjustments can be made.

Here, the case where the change of the game data amount is larger than the predetermined value is, for example, when the luminance change such as a flash scene is sharp, when the moving image is a still image, the still image is a moving image, and the whole image is a part of the image. The case of switching an image such as an up image, the case of switching sound such as a noise sound, and the like correspond.

The case where there is almost no change in the amount of game data corresponds to, for example, a state in which still images are continuous, a silent state, and the like.

[0035] Further, the invention described in claim 7 is based on claim 5,
6. In any one of the above 6, including a storage unit having a predetermined storage area for storing the received game data,
The calculating means calculates a ratio of the game data amount occupying the storage area, and the adjusting means determines that the difference between the calculated ratio and a desired ratio is larger than a predetermined value. It is characterized by thinning out or supplementing data.

According to the present invention, when the difference between the calculated ratio and the desired ratio is larger than a predetermined value, the game data is thinned or supplemented to adjust the game data without being noticed by the game player. it can.

Here, the case where the difference between the calculated ratio and the desired ratio is larger than a predetermined value includes the case where the calculated ratio exceeds the desired ratio and the case where the calculated ratio becomes the desired ratio. Both cases are less.

According to an eighth aspect of the present invention, in the seventh aspect, the storage means includes a frame buffer, and the monitoring means monitors a change in the amount of game data per frame in the frame buffer. The adjustment means thins out or supplements the stored game data when a change in the game data amount per frame is larger than a predetermined value or hardly changes as a result of the monitoring. I do.

According to the present invention, a change in the amount of data between frames is monitored, and when the change is large or little, the game data is thinned out or supplemented, so that the game player does not notice. Game data can be adjusted.

In particular, since image processing or the like is usually performed on a frame basis, a change can be clearly grasped by monitoring a change on a frame basis.

According to a ninth aspect of the present invention, there is provided a network system, wherein a plurality of client devices requesting acquisition of reproduction data and reproduction data are generated based on request data transmitted from the client device via a network. A network system comprising: a server device that compresses and distributes the compressed data to the client device, wherein the server device identifies a client device based on a unit that receives request data from the client device and the request data. Based on the request data,
Means for generating reproduction data for each predetermined unit, and means for compressing the generated reproduction data and transmitting the compressed data to the identified client device, wherein the client device transmits the request data to the server device. And send it to
Means for receiving the reproduction data; storage means for storing the received reproduction data; means for monitoring a change in the stored reproduction data amount for each predetermined unit; and storage in the storage means for each predetermined interval. Means for calculating the game data amount that has been calculated, and when the difference between the calculated data amount and the desired data amount is larger than a predetermined value, the stored reproduction data is converted to the stored reproduction data based on the monitoring result. Adjusting means for deleting or supplementing in predetermined units, means for expanding the reproduction data, reproduction means for reproducing the expanded reproduction data, and means for deleting reproduction data for which reproduction has ended from the storage means, It is characterized by including.

According to the present invention, when the difference between the calculated data amount and the desired data amount is larger than a predetermined value, the reproduction data is deleted or supplemented in the predetermined unit to thereby reduce the reproduction data. It is possible to adjust the reproduction data without the observer noticing.

Thus, synchronization between a plurality of client devices can be established without the observer of the reproduction data noticing.

The invention according to claim 10 is the same as the ninth invention.
In the above, the adjusting means, if the change in the data amount for reproduction is larger than a predetermined value or the change in the data amount for reproduction hardly changes, as a result of the monitoring, converts the stored reproduction data to the predetermined unit. It is characterized by deleting or supplementing.

According to the present invention, when the change in the data amount for reproduction is larger than the predetermined value or when the data amount for reproduction is hardly changed, the reproduction data can be thinned out or supplemented. The adjustment of the data for reproduction can be performed without notice of the observer.

Here, the case where the change in the amount of data for reproduction is larger than a predetermined value is, for example, when the luminance change such as a flash scene is sharp, when the moving image is a still image, the still image is a moving image, and the whole image is a part. The case of switching the image to the close-up image or the like, the case of switching the sound such as a noise sound, and the like correspond.

The case where there is almost no change in the data amount for reproduction corresponds to, for example, a state in which still images are continuous, a silent state, and the like.

[0048] Further, according to the invention of claim 11, in any one of claims 9 and 10, the reproduction data includes at least one of moving image data and audio data, and the reproducing means displays the moving image data. And means for reproducing the audio data.

In particular, if data is decimated or supplemented during reproduction of moving image data or audio data, an observer of the data tends to be noticed, and the observer wonders what has happened.

According to the present invention, even for moving image data or audio data, data adjustment can be performed in a state in which the observer is less likely to notice. Thus, the observer can comfortably reproduce the reproduction data without feeling uncomfortable.

Further, the information recording medium according to claim 12 is
In a network that transmits and receives compressed image data, a computer-readable information recording medium that records information for receiving and displaying the image data from a processing device on the transmission side, wherein the information is used to store the image data. Information for receiving, information for temporarily storing the received image data in storage means, information for expanding and displaying the image data stored in the storage means, and Information for erasing the data whose display has been completed from the storage means, information for calculating the accumulation rate of the image data in the storage means, and the accumulation rate is outside a predetermined range, and Information for thinning out or supplementing a part of the image data stored in the storage means when the image data is still image data. And butterflies.

According to the present invention, the computer that has read the information determines that the accumulation ratio of the image data is out of the predetermined range, thereby indicating that the image data needs to be adjusted.

Further, by thinning out or supplementing a part of the image data in the still image state, the image data can be adjusted without being noticed by the person watching the image.

Here, the thinning means processing data after the data in place of the data to be processed next, and the compensation means processing the data processed last time again. Say.

Further, according to the present invention, it is possible to synchronize the processing device on the transmission side with the computer that reads the information.

According to a thirteenth aspect of the present invention, there is provided a computer-readable information recording medium on which information for displaying compressed image data is recorded, wherein the information stores the image data in a storage area. Information for sequentially writing, read and decompress the image data in the storage area, information for display, when the image data amount occupying the capacity of the storage area is smaller than a desired value,
Using the written image data, expand and display information for supplementing image data for display, and expand and display when the image data amount occupying the storage area capacity is larger than a desired value. Information for deleting a part of the continuous image data in the storage area, and when the change in the image data amount is larger than a predetermined value or when the image data amount hardly changes, the replenishment or the And information for performing deletion.

According to the present invention, the computer which has read the information needs to adjust the image data by comparing the image data amount with the desired value and judging that the accumulation rate is out of the predetermined range. It can be seen that there is a certain state.

Further, according to the present invention, a change in the amount of image data is monitored, and the image data is supplemented or deleted in an inconspicuous state, so that a person who is viewing the image data does not notice it. Can be adjusted.

[0059]

Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) First, a game data distribution device functioning as a server device and a plurality of game devices functioning as client devices for displaying game images are connected via a network including a transmission path. An example in which the present invention is applied to a game system in which a game is played while synchronizing images between processing devices will be described.

FIG. 1 is a diagram showing an example of the game system according to the present embodiment.

In this game system, the C site where the game data distribution device 100 exists, the game device 200-
A site where game devices 1 and 2 exist, game devices 200-3 and 4
Are connected to each other via a so-called ATM network including a communication line 300 which is a transmission path.

When game image data is transmitted from the game data distribution device 100 to each game device 200, a network-type multiplayer game is played.

In such a network-type multi-player game system, in each game device 200, it may be necessary to simultaneously display a game image, adjust the game start timing, or change the screen resolution. .

In such a case, each game device 200
The image display timing of the game data distribution device 1
It may be necessary to make adjustments in order to synchronize with the image generation timing of 00 and the image display timing of another game device 200.

The operation clock of the game data distribution device 100 and the operation clock of the game device 200 are actually slightly different depending on the installation condition of each device, and therefore, a shift between the image generation timing and the image display timing is likely to occur. Needs to be corrected.

In such a case, when simply trying to adjust the image synchronization with the game device 200, the image displayed on the game device 200 may be disturbed for a moment, giving a discomfort to the person playing the game. .

In this embodiment, when switching the image,
The timing of image display and the like is adjusted in a flash scene or the like in which an image changes rapidly.

This makes it possible to adjust the timing of image display and the like so that a person watching the game image is not noticed, so that the image display timing can be adjusted without giving the player playing the game uncomfortable feeling. To display images or change the screen resolution.

Here, the term “adjustment” specifically refers to adjustment such as resetting the phase of an image synchronization signal, thinning out or supplementing an image, and advancing or delaying the timing of image display. Say.

Here, the thinning means processing data after the data to be processed instead of the data to be processed next, and the compensation means processing the data processed last time again. Say.

Specifically, taking the case of image processing as an example, as the former, for example, after displaying the image of the second frame, displaying the image of the fourth frame without displaying the image of the third frame That is true. In the latter case, for example, when the image of the third frame is not expanded in a situation where the image of the third frame should be displayed, the image of the displayed second frame is displayed again. I do.

Here, the time of image switching includes, for example, switching from displaying the character's face to displaying the entire character, changing the display resolution, displaying an image with a sharp change in luminance such as a flash scene, moving image to still image , A state in which different types of images such as a still image and a moving image are switched.

FIG. 2 is a functional block diagram of a game system according to an example of the present embodiment.

The game system includes a game device 200 that generates distribution request data generated based on an operation of a game player, and transmits the generated distribution request data;
A game data distribution device 100 that generates and compresses game data based on distribution request data from the game device 200 and that is transmitted via an ATM network including the communication line 300, and distributes the game data to the game device.

The game data distribution device 100 includes a transmission / reception unit 11 for receiving distribution request data from the game device 200.
6, a generation unit 112 for generating game data based on the received distribution request data, and a compression unit 114 for compressing the generated game data. The transmission / reception unit 116 transmits the game data compressed to the game device 200. Send.

Here, as game data, for example,
Game image data, game sound data, and the like correspond. That is, the generation unit 112 includes a game image data generation unit that generates game image data, and a game audio data generation unit that generates game audio data.

Since the amount of game sound data is smaller than that of game image data, it is possible to transmit the game sound data without compression.

On the other hand, the game device 200 has an operation data input section 235 for the game player to input operation data.
And a distribution request data generation unit 234 that generates distribution request data based on the input operation data, and transmits the generated distribution request data to the game data distribution device 100,
A transmission / reception unit 236 for receiving game data generated by the game data distribution device 100.

The game device 200 adjusts the synchronization of the game data with the frame buffer 246 functioning as a storage unit for storing the received game data, the buffer control unit 248 controlling data transmission in the frame buffer 246. A data synchronization unit 238.

The data synchronization section 238 in the game device 200 includes a data amount monitoring section 242 for monitoring a change in the amount of game data stored in the frame buffer 246,
A data amount calculating unit 241 for calculating a ratio of the game data amount occupying the frame buffer 246; and a game data stored based on the monitoring result when a difference between the calculated ratio and a desired ratio is larger than a predetermined value. And a data adjustment unit 239 for thinning out or supplementing.

Further, the game device 200 includes a decompression unit 244 for decompressing the compressed game data, and an image display unit 220 as reproduction means for reproducing the decompressed game data.
And a sound reproducing unit 222.

As described above, when the audio data is not compressed, the audio data may be directly transmitted from the frame buffer 246 to the audio reproduction unit 222 without passing through the decompression unit 244.

As for the hardware configuration, for example, buttons and levers are used as the operation data input unit 235, the audio playback unit 222 is a speaker and the like, the distribution request data generation unit 234, the data synchronization unit 238, and the buffer control unit 248. Can be a CPU or the like.

As the generation unit 112 and the compression unit 114, for example, a game board having a clock generator, a VRAM, a compression chip or the like which generates an image in response to an instruction from the CPU can be applied. As the transmitting / receiving unit 236, for example, a communication device such as an ATM switch can be applied.

Further, the extension section 244 and the image display section 22
As 0, for example, a video card and a display having a clock generator, a VRAM, a decompression chip, a D / A converter, and the like that display an image in response to a command from the CPU can be applied.

Further, as the communication line 300, for example,
An optical fiber or the like can be applied. Note that even if the communication line 300 is a wired one such as an optical fiber,
It may be wireless, such as a satellite communication path.

FIG. 3 is a diagram showing a schematic flowchart of the game data synchronization adjustment based on the buffer data comparison.

First, the operation of the game data distribution device 100 will be described.

The game data distribution device 100 having received the distribution request data from the game device 200 by the transmitting / receiving unit,
The game data is generated by the generation unit 10 (step 2
2).

The generated game data is compressed by the compression unit (step 24), and the transmission / reception unit of the game data distribution device 100 transmits the compressed game data to the game device 200 via the communication line 300. (Step 26). Next, the operation of the game device 200 will be described.

The transmission / reception unit 236 receives the game data transmitted from the game data distribution device 100 (step 28). The buffer control unit 248 transmits the received game data to the frame buffer 246 (Step 30).

Data amount monitoring unit 2 in data synchronization unit 238
42 monitors the change in the amount of compressed game data per frame in the frame buffer 246. Specifically, the data amount calculation unit 241 calculates the ratio of the game data amount occupying the frame buffer 246.

If the difference between the calculated ratio and the desired ratio is larger than a predetermined value, it means that the synchronization between the generated data and the reproduced data is out of sync, and it is necessary to adjust the synchronization of the game data ( Step 32).

In this case, based on the monitoring result, the data adjustment unit 239 thins out or supplements the game data stored in a state where the synchronization adjustment is inconspicuous (step 38) (step 40).

A series of processes (step 50) from the determination of the necessity of the synchronization adjustment to the adjustment of the thinning and the like will be described later in detail.

When there is no need for synchronization adjustment (step 3
2) The compressed game data is expanded by the expansion unit 44 (step 34), and the image display unit 22 functioning as a reproducing unit is expanded.
0 and the game data are reproduced by the sound reproduction unit 222 (step 36).

Next, a series of processes (step 50) from the above-described determination of the necessity of the synchronization adjustment to the adjustment of the thinning and the like will be described in detail by taking the processing of the game image data as an example.

FIG. 4 is a conceptual diagram showing the relationship between the frame buffer 246 and the positions indicated by various pointers.
Is a flowchart showing a series of processes (step 50) from determination of necessity of synchronization adjustment to adjustment of thinning and the like.

As shown in FIG. 4, the frame buffer 24
Reference numeral 6 includes six frame buffers 246-1 to 246-6 and has a predetermined storage area. Each frame buffer 246-1
-6 store compressed game image data for one screen for each frame buffer 246-1-6.

Note that the frame buffer 246 has a function as a so-called ring buffer that stores again from the frame buffer 246-1 when the storage up to the frame buffer 246-6 is completed.

Here, in order to decompress and display the compressed game image data, a reception completion pointer indicating the position where the received game image data has been stored in the frame buffer 246 and the game image data to be displayed from now on are stored. It is assumed that there is a display schedule pointer indicating the position of the frame buffer 246 that has been set.

Further, as the above-mentioned predetermined range, the difference between the address indicated by the reception completion pointer and the address indicated by the display schedule pointer corresponds to one frame buffer. That is, in the state where the reception completion pointer is at P3, the display schedule pointer is within the predetermined range if it is at the position of P2 to P3. For convenience of explanation, it is assumed that each pointer updates the address in units of one frame buffer.

Each of the frame buffers 246-1 through 246-6
Are respectively designated by P1 to P6 for convenience.
It is assumed that the reception completion pointer is at P3, that is, at the head of the third frame buffer 246-3, and the reception and storage of the game image data have been completed up to 246-3.

Next, such a frame buffer 246
The process in the case of using is described with reference to FIG.

First, it is determined whether or not the above-described adjustment is necessary (step 32). Specifically, the reception completion pointer is compared with the display schedule pointer (step 60), and whether the difference between the two is within a predetermined range is determined. It is determined whether it is (step 62).

Further, when it is not within the predetermined range, it is determined whether or not the state is inconspicuous (step 38).
Is specifically performed as follows.

First, the data amount monitoring unit 241 in the data synchronization unit 238 monitors a change in the amount of compressed game data per frame in the frame buffer 246. More specifically, the data amount calculation unit 242 controls the frame amount. The ratio of the game data amount in the buffer 246 is calculated.

The data amount monitoring unit 241 compares the calculated ratio in the previously displayed image with the calculated ratio to be displayed (step 6).
4).

If the change in the ratio is drastic, it is time to switch from a moving image to a still image, from a still image to a moving image, from an entire image to a partial up image, or to an image such as a flash scene. It can be determined that the state is inconspicuous (step 66).

Also, when these ratios are very small,
If there is no change in the ratio, it can be determined that the image has a high data compression ratio and a small change between the preceding and following images, that is, a still image that is inconspicuous even if the synchronization adjustment is performed (step 66).

It is also possible to adopt a configuration in which the determination is made based on a change in the data amount itself instead of a change in the ratio of the data amount.

When it is determined that the state is inconspicuous, the data adjustment unit 239 determines whether the display schedule pointer is ahead of the reception completion pointer or the display schedule pointer is significantly delayed from the reception completion pointer. Is determined (step 70).

If the display-scheduled pointer is ahead of the reception completion pointer, the data adjustment unit 239 returns the display-scheduled pointer to the previously displayed point (step 74). That is, this processing corresponds to the image supplement processing.

If the display schedule pointer is significantly delayed from the reception completion pointer, the display schedule pointer is set to 1
The image is advanced by an amount (step 72). That is, this processing corresponds to the image thinning processing.

As described above, by changing the data to be displayed next in the frame buffer 246 in an inconspicuous state, the data can be thinned out or supplemented, and the synchronization can be adjusted.

If the image is not inconspicuous (step 66), it is determined whether the reception and storage of the display-scheduled image has been completed (step 68). The pointer is returned to the previously displayed image (step 74). That is, this processing corresponds to the image supplement processing. If the game image data has been completed, the game image data is expanded and displayed.

If the address difference between the reception completion pointer and the display schedule pointer is within a predetermined range (step 62), the game image data is expanded and displayed, and the next inconspicuous state is waited for. Adjust the pointer.

Although the game image data processing has been described above, in the same manner as in the processing of the game sound data, it is possible to judge an inconspicuous state such as a noise sound, and to thin out or supplement the game sound data in an inconspicuous state. Can be.

When the game image data is a still image or image switching and the game audio data is silent, it is most preferable to adjust the reproduction schedule pointer such as the display schedule pointer. By adjusting in this state,
The synchronization can be adjusted not only by image display but also by sound reproduction without the player of the game noticing.

In the above example, the frame buffer 2
Although the case where the number of the frame buffers 246 is six has been described, it is preferable that the number of multiplexed frame buffers 246 is large. This is because if the number of buffers is large, the time to wait for a less noticeable state can be secured.

Even in the case of a single frame buffer that is not multiplexed, it can be adjusted by moving the pointer in units smaller than one frame buffer.

By employing the above processing means and processing method, the following operation and effect can be obtained.

In the conventional system, thinning or compensation is performed at the stage where the adjustment of game data is required, for example, at the critical point of the buffer. For this reason, a change in game data may cause the game player to know the timing of thinning or compensation, and may not be able to concentrate on the game.

According to the present embodiment, thinning and / or compensation can be performed in a state that is inconspicuous even if game data is adjusted based on the data amount monitoring result and the calculation result. Thereby, the game player can concentrate on playing the game.

According to this, it is possible to synchronize the game device with the game data distribution device without noticing the game player.

Also, since image processing is usually performed in frame units, by monitoring changes in frame units, changes can be clearly grasped and synchronization of game data and the like can be adjusted at appropriate timing. can do.

In this embodiment, the game device 20 is mainly used.
0 data reproduction timing, the game data distribution device 1
The synchronization method for synchronizing with the data generation timing of the game device 200 has been described. By synchronizing the data generation timing of the game data distribution device 100 and the data reproduction timing of the game device 200, Data reproduction timing can also be synchronized.

(Second Embodiment) In the first embodiment, an example of application to a game system has been mainly described. However, the present invention is not limited to a game system or a game device, but may be a general one such as an image display device. Application to an image processing device is also possible. In this embodiment, an example will be described in which the above-described function is realized using an information recording medium.

FIG. 6 is a diagram showing an example of functional blocks of an information recording medium 600 according to the present embodiment and an image display device 500 for reading the information recording medium 600.

The information recording medium 600 is a computer readable recording medium for receiving and displaying the image data from the processing device 502 on the transmission side via the communication line 570 in the network for transmitting and receiving the compressed image data. Information recording medium.

Here, the information includes the reception storage information 610 for receiving the image data and temporarily storing the received image data in a frame buffer 542 as storage means, and the reception storage information 610 for storing the received image data in the frame buffer 542. And decompressed display information 620 for decompressing and displaying the image data.

Further, the information includes calculation information 630 for calculating the accumulation rate of the image data in the frame buffer 542, and erasing the display-completed data of the image data from the frame buffer 542. When the rate is out of a predetermined range and the image data is still image data, adjustment information 64 for thinning out or supplementing a part of the image data stored in the storage means.
0 is included.

On the other hand, the image display device 500 having a computer for reading the information 610 to 640 has an information reading unit 590 for reading the information 610 to 640, a receiving unit 580 for receiving image data, and storing the received data. A frame buffer 542 and a buffer controller 548 for controlling data transmission of the frame buffer 542
And an image synchronizing unit 538 for synchronizing images, an expanding unit 560 for expanding compressed image data, and an image display unit 520 for displaying an expanded image.

Information 610 is read by information reading section 590.
640 is read, the image display device 500 is read.
Works as follows:

First, the reception storage information 610 is read, so that the receiving section 580 receives the compressed image data via the network, and the compressed image data received by the buffer control section 548 is transferred to the frame buffer 542.
Is stored temporarily.

When the calculation information 630 is read, the accumulation rate of the compressed image data in the frame buffer 542 is calculated by the data amount calculation unit 541 in the image synchronization unit 538.

Similarly, when the adjustment information 640 is read, the data adjustment unit 539 in the image synchronization unit 538 deletes the display-completed data of the image data from the frame buffer 542 so that the accumulation rate is within a predetermined range. Outside and when the image data is still image data, a part of the image data stored in the storage means is thinned out or supplemented.

That is, when the accumulation rate is extremely low and the accumulation rate is extremely high, it is determined that image data is insufficient or surplus, and that it is necessary to perform image synchronization adjustment.

When synchronization adjustment is required, if image data is thinned out or supplemented while still image data is displayed, synchronization adjustment of the image can be performed without being noticed by a person watching the image. .

Further, with respect to the image data whose synchronization has been adjusted, by reading the expanded display information 620, the compressed image data in the frame buffer 542 is expanded by the expansion unit 560, and the expanded image data is Displayed by the display unit 520.

Further, according to the present embodiment, by adjusting the synchronization of the image display device 500 that has read the above information, the synchronization between the processing device 502 on the transmission side of the compressed image data and the image display device 500 is adjusted. Can also be taken.

The processing device 502 includes, for example,
An image data generation / compression device, an image data compression device, and the like can be applied.

(Third Embodiment) FIG. 7 shows an information recording medium 800 according to another embodiment of the present invention.
FIG. 6 is a diagram illustrating an example of a functional block of an image display device 700 that reads an image.

The information recording medium 800 is an information recording medium that can be read by an image display device 700 having a computer that records information for displaying compressed image data.

Here, the information includes the image data,
Write information 810 for sequentially writing in the storage area;
Reading and expanding the image data in the storage area,
And expanded display information 820 for display.

[0147] Further, when the image data amount occupying the capacity of the storage area is smaller than a desired value, the information includes:
Using the written image data, expand and supplement image data for display, and when the image data amount occupying the storage area is larger than a desired value, expand and store the image data for display. Replenishment deletion information for performing the replenishment or the deletion when a part of continuous image data in a region is deleted and the change in the image data amount is larger than a predetermined value or when the image data amount is hardly changed; 830.

On the other hand, the image display device 700 having a computer for reading the information 810 to 830 has an information reading unit 790 for reading the information 810 to 830, a storage unit 710 for storing the compressed image data 712, and
A frame buffer 741 for temporarily storing the compressed image data 712; a buffer control unit 748 for controlling data transmission of the frame buffer 741; an image synchronization unit 738 for adjusting image synchronization; A decompression unit 714 for performing expansion and an image display unit 720 for displaying an expanded image are included.

Information 810 is read by information reading section 790.
830 is read, the image display device 700 is read.
Works as follows:

First, when the write information 810 is read, the buffer control section 748 sequentially writes the compressed image data 712 stored in the storage section 710 to the frame buffer 741 as a storage area.

When the replenishment / deletion information 830 is read, the image synchronization section 738 sets the frame buffer 7
When the compressed image data amount occupying the capacity of the frame buffer 741 is smaller than the desired value, the image data already written in the frame buffer 741 is used to supplement the image data for decompression and display, and occupy the frame buffer 741 capacity. When the image data amount is larger than a desired value, a function of deleting a part of continuous image data in the frame buffer 741 for decompression and display is performed.

According to this, the computer that has read the information needs to adjust the image data by comparing the image data amount with the desired value to determine that the accumulation rate is outside the predetermined range. It turns out that it is in a certain state.

Further, by reading the replenishment / deletion information 830, the image synchronizing unit 738 determines whether the replenishment or the deletion is performed when the change in the image data amount is larger than a predetermined value or when the image data amount hardly changes. To work.

According to this, the change in the amount of image data is monitored, and the image data is supplemented or deleted in an inconspicuous state, so that the image data can be adjusted without being noticed by a person who is viewing the image data. .

Further, with respect to the image data whose synchronization has been adjusted, the expansion display information 790 is read, so that the expansion unit 714 reads out the image data in the frame buffer 741 and expands the image data. Display the expanded image data.

(Other Embodiments) The present embodiment is not limited to the above-described game device such as the game device, the game data distribution device, the game system, and the like, and the embodiment of the present invention in the form of an information recording medium. The present invention can be applied to synchronization adjustment of various types of image processing and audio processing in a personal computer or a single computer.

For example, the following can be applied as a network system including a server device having an image generation function and a client device having an image display function.

First, reproduction data is generated and compressed based on a plurality of client devices requesting acquisition of reproduction data and request data transmitted from the client device via a network, and distributed to the client device. In a network system including a server device, the server device and the client device can be configured as follows.

The server device receives a request data from the client device, an identification unit for identifying the client device based on the request data, and a reproduction data for each predetermined unit based on the request data. And a transmitting unit for compressing the generated reproduction data and transmitting the compressed data to the identified client device.

Also, the client device transmits the request data to the server device and receives the reproduction data, a storage unit for storing the received reproduction data, a storage unit for storing the received reproduction data, A monitoring unit for monitoring a change in the data amount for reproduction, a calculation unit for calculating the game data amount stored in the storage means at predetermined intervals, and a difference between the calculated data amount and a desired data amount. Is larger than a predetermined value, based on the monitoring result, an adjusting unit that deletes or replenishes the stored reproduction data in the predetermined unit, an expansion unit that expands the reproduction data, A playback unit that plays back data; and a deletion unit that deletes playback data for which playback has ended from the storage unit.

By adopting such a configuration, when the difference between the calculated data amount and the desired data amount is larger than a predetermined value, the reproduction data is deleted or supplemented in the predetermined unit, thereby The adjustment of the reproduction data can be performed without the observer of the reproduction data noticing.

[0162] Thus, it is possible to synchronize the plurality of client devices without noticing the observer of the reproduction data. In particular, by providing the identification unit, it is possible to appropriately identify even if there are a plurality of client devices, and to distribute the reproduction data only to the client device that has requested the reproduction data. As a result, unnecessary traffic on the network can be eliminated.

Further, as a result of the monitoring, if the change in the data amount for reproduction is larger than a predetermined value or the change in the data amount for reproduction is hardly changed, the adjustment unit deletes the stored reproduction data. It is possible to configure so as to delete or supplement in the predetermined unit.

With this configuration, when the change in the amount of data for reproduction is larger than a predetermined value or when the amount of data for reproduction hardly changes, it is possible to thin out or supplement the data for reproduction. The reproduction data can be adjusted without the observer of the reproduction data noticing.

Here, when the change in the amount of data for reproduction is larger than a predetermined value, for example, when the luminance of a flash scene or the like changes drastically, a still image from a moving image, a moving image from a still image, and a part from the whole image are used. The case of switching the image to the close-up image or the like, the case of switching the sound such as a noise sound, and the like correspond. In such a case, by performing the synchronization adjustment, the reproduction data can be appropriately adjusted without being noticed by the observer.

The case where there is almost no change in the data amount for reproduction corresponds to, for example, a state in which still images are continuous, a silent state, and the like. In such a case, and
When the adjustment is performed by thinning or compensation, the reproduction data can be adjusted without making the observer aware of the thinning or compensation.

Further, the reproduction data includes at least one of moving image data and audio data, and the reproducing unit controls at least one of an image display unit for displaying the moving image data and an audio reproducing unit for reproducing the audio data. Including.

In particular, if data is thinned out or supplemented during reproduction of moving image data or audio data, an observer of the data tends to be noticed, and the observer thinks suspiciously of what has occurred.

According to this, even for moving image data or audio data, data adjustment can be performed in a state where the observer is less likely to notice. This allows the observer to reproduce the reproduction data comfortably without feeling uncomfortable.

[0170] These synchronization adjustment techniques are the same as those described in detail in the first embodiment.

[0171]

[Brief description of the drawings]

FIG. 1 is a diagram showing an example of a network system using a game data distribution device and a game device according to the present embodiment.

FIG. 2 is a diagram showing an example of functional blocks of the game system according to the present embodiment.

FIG. 3 is a diagram showing an example of a flowchart of image synchronization adjustment by data comparison according to the present embodiment.

FIG. 4 is a conceptual diagram showing a relationship between a frame buffer according to the present embodiment and positions indicated by various pointers.

FIG. 5 is a flowchart illustrating a series of processes from determination of necessity of synchronization adjustment to adjustment of thinning and the like.

FIG. 6 is a diagram illustrating an example of functional blocks of an information recording medium according to the present embodiment and an image display device that reads the information recording medium.

FIG. 7 is a diagram illustrating an example of an information recording medium according to another embodiment of the present invention and functional blocks of an image display device that reads the information recording medium.

[Explanation of symbols]

 Reference Signs List 100 game data distribution device 112 generation unit 114 compression unit 116, 236 transmission / reception unit 200 game device 220, 520, 720 image display unit 222 sound reproduction unit 234 distribution request data generation unit 235 operation data input unit 238, 538, 738 image synchronization unit 239, 539 Data adjustment unit 241, 541 Data amount calculation unit 242 Data amount monitoring unit 244, 560, 714 Decompression unit 246, 542, 741 Frame buffer 248, 548, 748 Buffer control unit 300, 570 Communication line 500, 700 Image display Device 502 Processing device 580 Reception unit 590 Information reading unit 600, 800 Information recording medium 610 Reception storage information 620, 820 Decompression display information 630 Operation information 640 Adjustment information 710 Storage unit 712 Compressed image data 810 Write Information 830 replenishment delete information

Claims (13)

[Claims] 1. A game device to which operation data of a game player is input and transmits distribution request data generated based on the operation data, and a game device based on distribution request data transmitted from the game device via a network. A game data distribution device that generates and compresses game data including at least one of image data and game audio data, and distributes the game data to the game device. Means for receiving distribution request data, means for generating game data based on the received distribution request data, and means for compressing the generated game data and transmitting the compressed data to the game device. Generating the distribution request data based on operation data input by the game player; Means for transmitting to the game data distribution device and receiving the game data from the game data distribution device; means for expanding and reproducing the received game data; and the amount of the received game data in a compressed state. Means for monitoring the change of the game data; calculating means for calculating the received game data amount in a compressed state; adjusting means for thinning out or supplementing the received game data based on the monitored result and the calculated result. And a game system comprising: 2. The game system according to claim 1, wherein the adjusting unit performs thinning or supplementing of the game data when a change in the game data amount is larger than a predetermined value as a result of the monitoring. . 3. The method according to claim 1, wherein the adjusting unit performs thinning or supplementing of the game data when there is almost no change in the game data amount as a result of the monitoring. Game system. 4. The storage device according to claim 1, further comprising a storage unit having a predetermined storage area for storing the received game data, wherein the calculation unit stores the game data amount in the storage area. A game system comprising: calculating a ratio of the stored game data when the difference between the calculated ratio and a desired ratio is larger than a predetermined value. . 5. A means for a game player to input distribution request data, transmitting the input distribution request data to a game data distribution device via a network, and including at least one of game image data and game audio data. Means for receiving game data; means for expanding and playing the received game data; means for monitoring changes in the amount of received game data in a compressed state; and means for monitoring the amount of received game data in a compressed state. A game device comprising: a calculating means for calculating; and an adjusting means for thinning out or supplementing the received game data based on the monitored result and the calculated result. 6. The received game data according to claim 5, wherein, as a result of the monitoring, when the change in the game data amount is larger than a predetermined value or when the game data amount hardly changes, A game device for thinning out or supplementing. 7. The storage device according to claim 5, further comprising a storage unit having a predetermined storage area for storing the received game data, wherein the calculation unit stores the game data amount in the storage area. A game device, wherein the adjusting means performs thinning or supplementing of the stored game data when a difference between the calculated ratio and a desired ratio is larger than a predetermined value. . 8. The storage device according to claim 7, wherein the storage unit includes a frame buffer, the monitoring unit monitors a change in a game data amount per frame in the frame buffer, and the adjustment unit performs the monitoring. As a result, when the change in the amount of game data per frame is larger than a predetermined value or when there is almost no change, the stored game data is thinned out or supplemented. 9. A method for generating and compressing reproduction data based on a plurality of client devices requesting acquisition of reproduction data and request data transmitted from the client device via a network, and distributing the generated data to the client device. A network system that includes: a server device; a server that receives request data from the client device; a unit that identifies the client device based on the request data; and Means for generating reproduction data for each predetermined unit; and means for compressing the generated reproduction data and transmitting the compressed data to the identified client device. The client device transmits the request data to the server device. Means for transmitting the data for reproduction and receiving the data for reproduction, Storage means for storing the amount of reproduction data stored for each of the predetermined units; means for calculating the game data amount stored in the storage means for each predetermined interval; Adjusting means for deleting or supplementing the stored reproduction data in the predetermined unit based on the monitoring result when a difference between the obtained data amount and the desired data amount is larger than a predetermined value; and A network system, comprising: means for expanding the data; reproducing means for reproducing the expanded reproduction data; and means for deleting the reproduction data whose reproduction has been completed from the storage means. 10. The storage device according to claim 9, wherein, as a result of the monitoring, when the change in the data amount for reproduction is larger than a predetermined value or when the data amount for reproduction is hardly changed, A network system for deleting or supplementing the reproduced data in the predetermined unit. 11. The reproduction data according to claim 9, wherein the reproduction data includes at least one of moving image data and audio data, and the reproducing unit reproduces the moving image data and the audio data. A network system comprising at least one of the means for performing the following. 12. A computer-readable information recording medium which records information for receiving and displaying the image data from a processing device on a transmission side in a network for transmitting and receiving compressed image data, wherein the information is: Information for receiving the image data, information for temporarily storing the received image data in a storage unit, information for expanding and displaying the image data stored in the storage unit, Information for erasing, from the storage unit, data of which display has been completed among the image data; information for calculating a storage ratio of the image data in the storage unit; and a storage ratio outside the predetermined range. And for thinning out or supplementing a part of the image data stored in the storage means when the image data is still image data. Information recording medium, characterized in that it comprises a distribution, the. 13. A computer-readable information recording medium recording information for displaying compressed image data, the information comprising: information for sequentially writing the image data in a storage area; Reading and expanding the image data in the storage area,
Information for displaying, when the image data amount occupying the capacity of the storage area is smaller than a desired value, using the written image data, decompressing, for supplementing the image data for display And information for deleting a part of continuous image data in the storage area for decompression and display when the amount of image data occupying the capacity of the storage area is larger than a desired value. An information recording medium characterized by including.