WO2011077345A1

WO2011077345A1 - Programming of a macro

Info

Publication number: WO2011077345A1
Application number: PCT/IB2010/055934
Authority: WO
Inventors: Yve De Buysscher; Rogier Louis Jacques Willem Thissen
Original assignee: Koninklijke Philips Electronics N.V.
Priority date: 2009-12-21
Filing date: 2010-12-20
Publication date: 2011-06-30

Abstract

When a system (100) comprising a plurality of home entertainment devices (110,120,130) is controlled by means of a universal remote control (200) having macro functionality, there is a significant chance that the rendering device (110) is not switched to the correct input (140), i.e. the input at which it receives audio or video data from a source device (120,130). In order to deal with this problem, the rendering device (110) is switched to the plurality of inputs (140) thereof one by one. It is detected if a user confirms that the rendering device (110) renders the audio/video data received from the source device (120). The input (140) to which the rendering device is switched at the time of detecting the user confirmation is the correct input, i.e. the input at which the rendering device (110) receives the data from the source device (120,130). The macro is programmed with the correct input switching command.

Description

Programming of a

BACKGROUND OF THE INVENTION TECHNICAL FIELD

The present invention relates to the field of remote controls and more specifically to remote controls for controlling the functionality of a plurality of devices by means of macros.

DESCRIPTION OF RELATED ART

Controlling home entertainment devices such as TV's, DVD players and Home Theatre Systems, has become more and more complex. Many people now own a TV, a decoder for digital TV, a DVD player, some kind of home theatre system and a game console. Traditionally, each of the devices comes with its own remote control. As a result, when a user wishes to perform an activity including a plurality of these devices, he is required to use the remote controls of all of them. For example, if the user wishes to watch a DVD, he has to switch the DVD player on with the DVD remote control and the television set with the TV remote control. Furthermore, if the television set does not switch

automatically to the input to which the DVD player is connected, the user also has to switch the TV set to this input with the TV remote control.

In order to improve the user friendliness of controlling a plurality of home entertainment devices, universal remote controls have been developed. Hereby, the user is enabled to control all devices with a single remote control. Some of the universal remote controls offer macro functionality. Such macro functionality allows the user to program a macro, i.e. a sequence of actions including commands (key presses), corresponding to a certain activity. These commands are sent in one go from the remote control to the different devices involved in the activity. However, programming a macro is quite a tedious task for a user.

To avoid the difficult task of programming the macro, a software application can attempt to generate the macro for the user. However, automatic programming of a macro is difficult, because a lot of information is needed about the user and about the behavior of the devices. In particular, it is complicated to program the macro with the correct switching command corresponding to a certain activity. The switching command is the command for switching the rendering device to the input at which the source device, which is involved in the activity, is connected. Referring again to the activity of watching a DVD, some TV sets (rendering devices) comprise a fixed input for connecting to the DVD player (source device) but in many TV sets the DVD player can be connected to any one of the A/V inputs. In order to work correctly, the macro for the activity "watching a DVD" should, apart from the commands for turning both the DVD player and the TV set on, comprise the input switching command for switching the TV set to the input at which the DVD player is connected.

It is clear, that there is a significant chance that the input switching command in the macro is not programmed, correctly. The correction by a user of the macro, so that the rendering device is switched to the correct source device, is a tedious and user unfriendly activity.

US 2009/025400 Al discloses a method and system for centrally controlling the operation of the rendering and source devices within a network of consumer electronics devices and in particular the switching of input and output ports thereof, However, this adds to the complexity and the costs of the system.

SUMMARY OF THE INVENTION

It is an object of the invention to provide an effective way to program the macro with the correct input, i.e. the input at which it receives data from a source device for rendering.

To better address this concern, according to an aspect of the invention an apparatus is provided, which is configured for programming a macro for controlling a system that comprises a source equipment and a rendering equipment having a plurality of inputs, the macro setting the system into a state wherein the source device supplies the data to the rendering device and the rendering device is switched to the input at which it receives the data from the source device. The apparatus according to the invention comprises a controller being configured for executing:

- an input switching step of switching the rendering device to the plurality of inputs thereof one by one;

a user confirmation detection step of detecting a user confirmation that the rendering device renders the data received from the source device and thereby detecting the input at which the rendering device receives the data from the source device; and executing a command programming step of programming the macro with the input switching command corresponding to the detected input.

The input to which the rendering device is switched at the time of detecting the user confirmation is the input at which the rendering device receives the data from the source device. As a result, the detection of the correct input is performed in a simple and effective way and the macro is programmed with the corresponding input switching command.

When the user executes an existing macro and notices that the rendering device is connected to the wrong input, either because he does not see the correct video or because he does not hear the correct sound, he may initiate the input switching step for correcting the macro. Alternatively, the input switching step may be initiated for generating a macro for a certain activity and programming it with the correct switching command.

According to an embodiment, the controller is configured for providing, during the input switching step, input switching commands for switching the rendering device to the plurality of inputs thereof and the apparatus further comprises a sender for sending the switching commands to the rendering device. As a result, the input switching step is performed by using the same commands as those that are used during normal operation of the macro. The apparatus may be a universal remote control, which is used for controlling source devices and rendering devices by means of macros.

The invention may be used with both types of input switching commands that are commonly used by remote controls:

discrete input functions for directly switching the rendering device to a particular input; and

switching commands for cyclically switching through the plurality of inputs of the rendering device.

According to a still further embodiment, the controller is configured for automatically providing the input switching commands during the input switching step. The automatic providing of the input switching commands continues as long as a user provides a predetermined user input, for example pressing a key. The discontinuing by the user of providing the predetermined user input, for example the release of the key by the user, serves as the user confirmation that the rendering device renders the data received from the source device. This is an intuitive way of user interaction with the apparatus because it is consistent with existing methods for "repairing" the functionality of keys on remote controls and also for detecting the correct set of IR codes (code set) of a device. However, according to an alternative embodiment the automatic providing of the input switching commands continues until a user provides a predetermined user input and the predetermined user input serves as the user confirmation that the rendering device renders the data received from the source device. This is a different intuitive way of user interaction with the apparatus, which has as advantage that the user does not need to keep a key pressed for a relatively long period.

According to a further alternative embodiment, the controller is configured for providing each of the input switching commands during the input switching step after a corresponding user input.

According to a further aspect of the invention, a method is provided of programming a macro for controlling a system that comprises a source equipment and a rendering equipment having a plurality of inputs, the macro setting the system into a state wherein the source device supplies the data to the rendering device and the rendering device is switched to the input at which it receives the data from the source device, comprising the following steps:

an input switching step of switching the rendering device to the plurality of inputs thereof one by one;

a user confirmation detection step of detecting a user confirmation that the rendering device renders the data received from the source device and thereby detecting the input at which the rendering device receives the data from the source device , which corresponds to the input to which the rendering device is switched, when the user

confirmation is detected; and

a command programming step of programming the macro with the input switching command corresponding to the detected input.

Preferably, the method according to the invention is implemented by means of a computer program.

The computer program may be embodied on a computer readable medium or a carrier medium may carry the computer program.

These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.

BRIEF DESCRIPTION OF THE DRAWINGS The invention will be better understood and its numerous objects and advantages will become more apparent to those skilled in the art by reference to the following drawings, in conjunction with the accompanying specification, in which:

Fig. 1 shows a block diagram of a home entertainment system with which the present invention may be used.

Fig. 2 shows a block diagram of an exemplary embodiment of a universal remote control wherein the present invention may be implemented.

Fig. 3 shows a first type of input switching commands for which the invention may be used.

Fig. 4 shows a second type of input switching commands for which the invention may be used.

Fig. 5 shows a flowchart of correcting a macro according to an exemplary embodiment of the invention.

Throughout the figures like reference numerals refer to like elements.

DETAILED DESCRIPTION OF THE PRESENT INVENTION

Figure 1 shows a system 100 comprising a plurality of home entertainment devices. The system comprises one rendering device 110, a digital TV, and two source devices, a DVD player 120 and a receiver/decoder for satellite TV 130. The digital TV comprises a plurality of A/V inputs 140. The satellite TV receiver 130 is connected to a first one 140-1 of the inputs, the second one of the inputs 140-2 is not connected and the DVD player 120 is connected to the third one of the inputs 140-3. The user controls the plurality of home entertainment devices with a universal remote control 200.

Figure 2 shows a block diagram of the universal remote control 200. It comprises a controller 210, which is preferably a processor that comprises an associated memory loaded with a suitable computer program, an Infra Red (IR) transmitter 220, a user input arrangement 230, for example a plurality of keys, and a user output arrangement 240, for example a display. The universal remote control 200 by means of transmitter 220 sends IR commands to the digital TV 110, DVD player 120 and satellite TV receiver 130 for controlling the functionality thereof. These devices all comprise IR detectors 150 for detecting the commands sent by the universal remote control 200 and are configured for executing the functions corresponding to the commands received from the universal remote control 200, as is well known as such. The universal remote control 200 is configured for controlling the plurality of devices 110,120,130 by means of macros. A macro comprises a plurality of actions, which may include commands, corresponding to a certain activity. Figure 3 shows a typical macro 300 as a function of time t. It consists of three parts:

1. Commands to switch the equipment on, which is involved in the activity.

Taking the example of a macro corresponding to the activity of watching a DVD, for this purpose a command 310 is sent for turning the TV on and a command 320 is sent for turning the DVD player on.

2. A delay period 330 enabling for the involved devices to start up, until they are ready to receive commands and react thereto. A suitable value for this delay period is 15 seconds.

3. An input switch command 340 for setting the rendering device, (in this example the TV) to the correct input. In the example shown in figure 1, the TV 110 should be switched to its third A/V input 140-3 in case that the activity is watching DVD. In this way, it receives the DVD data (audio and video) from the DVD player 120 and it is enabled to render these data.

The input switch command 340 may be a discrete input function for directly switching the rendering device to a particular input. Such discrete input functions are usually not present on the original remote controls belonging to rendering devices but universal remote controls often contain them. In the example of watching DVD in the configuration shown in figure 1 , the correct discrete input switching function is a command directly switching the TV to the third A/V input 140-3.

Alternatively, the input switching command is of the "cyclical" type, as shown in detail in figure 4. These input switching commands of the cyclical type are generally available on the original remote controls belonging to rendering devices. An example is the "A/V key", which is available on the great majority of remote controls for TV sets. By repeatedly pressing this key, the TV set is cyclically switched through all its inputs. Input switching commands of a cyclical type can only be successfully used when it is known to which one of the A/V inputs the rendering device is switched, when it is first turned on. This generally is the first A/V input. In the example of a macro corresponding to the activity of watching DVD in the configuration shown in figure 1 and assuming that the TV set 110 is switched to the first A/V input 140-1 when it is turned on, the input switching command of the cyclical type should consist of two cyclical switching commands 400. The first one thereof switches the TV first to the second A/V input 140-2 and the second one thereof switches it to the third AV input 140-3.

The first part of a macro corresponding to a certain activity, i.e. the part consisting of the commands 310,320 to turn the involved devices on, can be generated in a reliable way without asking any information to the user. For the second part a default delay 330 can be selected that works for most of the devices available on the market, e.g. 15 seconds. However, the programming of the third part of the macro, the part related to switching the rendering device to the correct input, may be difficult. It should be noted that in some cases the second and third part of the macro are not needed because the rendering device automatically detects the active input at which it receives the data from the source device and switches to this input. However, this is certainly not true for all rendering devices available on the market.

Figure 5 shows a flow chart of an exemplary way of correcting an existing macro corresponding to a certain activity involving a source device and a rendering device. Figure 5 applies to the case that the involved rendering device recognizes discrete input functions. First, the user executes an existing macro, e.g. by pressing an activity key of the user input arrangement 230 like "Watch DVD" (step 500). The controller 210 of the remote control 200 retrieves the corresponding macro 300 from its associated memory and the IR sender 220 sends it to the devices. If the user then notices that the rendering device is on the wrong input, for example because he does not see the (correct) picture or does not hear the (correct) sound, he initiates a macro correction procedure (step 505). Thereto, the input arrangement 230 of the universal remote control 200 may comprise a special key.

Alternatively, a combination of existing keys may be pressed by the user. The controller 210 determines if there are any discrete input functions available in its memory for the rendering device involved in the activity (step 510). If this is the case, a help wizard is activated on the display 240 of the universal remote control (step 515). This help wizard shows instructions for the user and the status of the macro correction procedure. For example, the user may be instructed to press and hold a special "FIX macro" key on the user input arrangement 230 until he sees or hears the correct picture/sound of the source device.

Next, it is detected if the user presses the "FIX macro" key (step 520). If this is the case, the input switching step 525 is started of sequentially switching the rendering device to the plurality of inputs thereof. The help wizard shows status information of the correction procedure combined with an instruction (step 530), for example "Trying option 1 of 3 Keep the remote pointed towards your TV" or the like. Furthermore, the input switch command comprising the first discrete input function is provided by the controller (i.e. retrieved from its associated memory) and sent to the rendering device (step 535). Next, it is detected if the "FIX macro" key is released by the user (step 540). The releasing of this key is the user confirmation that the correct picture/sound of the source device is rendered by the rendering device. This means that the rendering device is switched to the correct input for the activity corresponding to the macro. If the key is released, the providing and sending of the input switch command is stopped. So, in this exemplary embodiment the controller is configured for automatically providing the input switching commands one by one as long as the user presses the "FIX macro" key.

Next, the help wizard requests a confirmation from the user that he indeed sees/hears the correct picture/audio (step 545). It is determined if the user confirms this or not (step 550). If the user confirms, in a command programming step (step 555) the original input switching command in the macro is replaced with the input switching command that was last sent (i.e. the one that switches the rendering device to the correct input for the activity) and the help wizard informs the user that the macro for the activity has been adjusted (step 560). It can also be that originally, there was no input switching command in the macro. In that case, a delay followed by the input command that was last sent is added to the macro. The help wizard may automatically close after a time-out period and the mode screen, which was last displayed before the macro correction procedure, may be displayed, again. Alternatively, the user should exit the help wizard by providing an exit command and an option thereto is displayed by the help wizard.

If the user indicates that the rendered picture/audio is not correct, the process continues from the last input switching command (step 565), i.e. the flow picks up where it left off before. As the user indicates that the rendered picture/audio is not correct, it should be assumed that he accidentally released the "FIX macro" key.

If the key is not released (step 540), it is checked if a time out is expired (step 570). A suitable time-out period is a few seconds to give the equipment and the user some time to react in case that the correct audio/video is rendered. When the time-out expires, it is checked if all input switching commands have been tried (step 575). If this is not the case, the next input switching command option is tried (step 580). The flow loops back to steps 530 and 535, for providing and sending the next input switching command. In case that the next input switching command is the second one, this results in displaying the following text "Trying option 2 of 3 Keep the remote pointed to your TV". If all input switching commands have been tried without success, the macro correction procedure is terminated without amending the macro (step 585). The user is recommended to manually try and fix the macro in this case.

So, the discrete input functions are automatically scanned through to find the correct input of the rendering device corresponding to a certain macro activity. As shown in figure 5, the procedure may be used for correcting erroneous macros by replacing the wrong input switching command present in the macro by the correct input switching command for the corresponding activity or by adding a missing switching command to the macro. The procedure shown in figure 5 is implemented by means of a suitable computer program loaded to the associated memory of the processor 210. So, in the embodiment shown in figure 5 the apparatus configured for programming the macro is entirely contained in the remote control.

Alternatively, the procedure of figure 5 may be used in the process of generating macros instead of correcting macros. As the generation of the first part of the macro (the commands turning the involved devices on) is easy, this may be executed in a manner known as such, resulting in a "start" macro (an incomplete macro). Then in order to generate the remaining part of the macro, first the already existing part of the macro ("part 1) is executed (similar to step 500). The user is then requested to confirm if the correct picture/sound of the source device is rendered by the rendering device. This may be the case, if the rendering device automatically switches to the active input at which it receives the data from the source device, as explained herein above. In that case, there is no need to generate the remaining part of the macro (i.e. the time out period 330 and the input switching command 340) and the procedure is terminated.

In case that the user indicates that the audio/video is not rendered correctly, the input switching functions are sent by the remote control 200 to the rendering device one by one until the user confirms that the correct data are rendered, as described herein above with reference to steps 525 and further of figure 5. In case of success, the correct input switching command 340 is added to the "start" macro preceded by the default time delay 330 in a command programming step.

It may be the case that the rendering device only recognizes switching commands of a cyclical type. If this is so, the process shown in figure 5 may be amended as follows: The device is first put into a 'known state', for example by sending first the digit 1 function (puts for example a TV on channel 1). The number of cyclical switching commands is counted from the known state. The command(s) that put the device in the known states, followed by the number of cyclical switching commands are added to the macro. According to a different embodiment, the input switching step 525 is initiated by pressing and releasing a key. As long as no further inputs are given, the input switching commands are provided by the controller 210 and sent to the rendering device by the transmitter 220 one-by-one. Again, the help wizard shows instructions for the user and the status of the macro correction procedure. For example, the user may be instructed to press and release the same key again when he sees or hears the correct picture/sound of the source device. So, contrary to the embodiment shown in figure 5, the user does not need to keep a key pressed continuously during the whole process of sending input switching commands.

According to a further example, the switching commands are not sent automatically but the user has to give an instruction each time that the next one of the switching commands has to be sent. In this case, the absence of a new instruction to send an input switching command serves as the user confirmation that the rendering device renders the correct audio/video. The help wizard may show instructions for the user regarding the key(s) to press to generate the next switching command.

Instead of displaying the user instructions and the progress of the process of generating or correcting a macro on the display 240 of the universal remote control 200, the instructions and progress can also be displayed by the rendering device. For this purpose, the controller (not shown) of the rendering device 110 should be loaded with a suitable computer program. The rendering device displays the instructions and the progress based on commands received from the universal remote control. So, in this embodiment the apparatus configured for programming a macro is contained in the rendering device. The remote control does not require any changes in its software but it may work like any known remote control. It does not even need to be a universal remote control.

In a further alternative example, the instructions for the user and the progress information are displayed on the screen of the rendering device and the user uses input keys thereof for starting and stopping the input switching step. For example, similarly to the embodiment shown in figure 5, the input switching step may be started when the user presses a certain key, continued as long as the user presses this key and stopped when the key is released. This input switching step exists of sequentially switching the rendering device to the plurality of inputs by means of internal commands thereof. The correct input switching command determined in this way, may be transmitted to the universal remote control 200 by means of an IR or RF link. So, the universal remote control 200 and the rendering device should be configured for two-way communication. While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments.

For example, the present invention cannot only be implemented with handheld universal remote controls, as described herein above but also with other remote controls configured for transmitting macros to a plurality of devices. A first example thereof is a so called RF-extender, which receives commands from a handheld controller by means of an RF-link and resend these commands using IR. Another example is a set-top box configured to receive IR commands or RF commands from a handheld controller and resend them to a plurality of devices using IR. A still further example is a windows media center implemented on a Personal Computer, which is configured for sending IR commands by means of an IR transmitter typically connected to a USB port of the PC.

Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measured cannot be used to advantage. A computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems. Any reference signs in the claims should not be construed as limiting the scope.

Claims

CLAIMS:

1. Apparatus (200) configured for programming a macro for controlling a system that comprises a source equipment (120,130) and a rendering equipment (110) having a plurality of inputs (140), the macro setting the system into a state wherein the source device supplies the data to the rendering device and the rendering device is switched to the input at which it receives the data from the source device, the apparatus comprising a controller (210) being configured for executing:

an input switching step (525) of switching the rendering device to the plurality of inputs thereof one by one;

a user confirmation detection step (540) of detecting a user confirmation that the rendering device renders the data received from the source device and thereby detecting the input at which the rendering device receives the data from the source device, which input corresponds to the input to which the rendering device is switched, when the user

confirmation is detected; and

executing a command programming step (555) of programming the macro with the input switching command corresponding to the detected input.

2. Apparatus according to claim 1, wherein the controller is configured for providing (535), during the input switching step, input switching commands (340) for switching the rendering device to the plurality of inputs thereof; and

- the apparatus further comprising a sender (220) for sending the switching commands to the rendering device.

3. Apparatus according to claim 1, wherein the input switching command corresponds to a discrete input function for directly switching the rendering device to a particular input.

4. Apparatus according to claim 1, wherein the input switching command comprises one or more cyclical switching commands (400) for cyclically switching through the plurality of inputs of the rendering device.

5. Apparatus according to claim 2, wherein the controller is configured for automatically providing the input switching commands during the input switching step.

6. Apparatus according to claim 5, wherein the automatic providing of the input switching commands continues as long as a user provides a predetermined user input.

7. Apparatus according to claim 6, wherein the discontinuing by the user of providing the predetermined user input serves as the user confirmation that the rendering device renders the data received from the source device.

8. Apparatus according to claim 5, wherein the automatic providing of the input switching commands continues until a user provides a predetermined user input.

9. Apparatus according to claim 8, wherein the predetermined user input serves as the user confirmation that the rendering device renders the data received from the source device.

10. Apparatus according to claim 2, wherein the controller is configured for providing each of the input switching commands during the input switching step after a corresponding user input.

11. Method of programming a macro for controlling a system that comprises a source equipment (120,130) and a rendering equipment (110) having a plurality of inputs (140), the macro setting the system into a state wherein the source device supplies the data to the rendering device and the rendering device is switched to the input at which it receives the data from the source device, comprising the following steps:

- a user confirmation detection step (540) of detecting a user confirmation that the rendering device renders the data received from the source device and thereby detecting the input at which the rendering device receives the data from the source device , which corresponds to the input to which the rendering device is switched, when the user confirmation is detected; and a command programming step (555) of programming the macro with the input switching command corresponding to the detected input.

12. Method according to claim 11, wherein during the input switching step, input switching commands are provided (535) for switching the rendering device to the plurality of inputs thereof and the input switching commands are sent (535) to the rendering device.

13. A computer program comprising computer program code means adapted to perform the step according to claim 11 when said program is run on a computer.

A computer program as claimed in claim 13 embodied on a computer readable

15. A carrier medium carrying the computer program of claim 13.