+

WO2002039450A2 - Method for switching from scanning the content to playing the content - Google Patents

Method for switching from scanning the content to playing the content Download PDF

Info

Publication number
WO2002039450A2
WO2002039450A2 PCT/EP2001/013020 EP0113020W WO0239450A2 WO 2002039450 A2 WO2002039450 A2 WO 2002039450A2 EP 0113020 W EP0113020 W EP 0113020W WO 0239450 A2 WO0239450 A2 WO 0239450A2
Authority
WO
WIPO (PCT)
Prior art keywords
speed
processing
data stream
stream
location
Prior art date
Application number
PCT/EP2001/013020
Other languages
French (fr)
Other versions
WO2002039450A3 (en
Inventor
Jeroen Heuvelman
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Priority to EP01993928A priority Critical patent/EP1336176A2/en
Priority to JP2002541682A priority patent/JP2004513589A/en
Priority to KR1020027008767A priority patent/KR20020071924A/en
Publication of WO2002039450A2 publication Critical patent/WO2002039450A2/en
Publication of WO2002039450A3 publication Critical patent/WO2002039450A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/005—Reproducing at a different information rate from the information rate of recording
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/107—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating tapes
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/27—Arrangements for recording or accumulating broadcast information or broadcast-related information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/37—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
    • H04H60/377—Scene
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/46—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for recognising users' preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/59—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/61—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/65—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 for using the result on users' side
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/68—Systems specially adapted for using specific information, e.g. geographical or meteorological information
    • H04H60/73—Systems specially adapted for using specific information, e.g. geographical or meteorological information using meta-information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/2866—Architectures; Arrangements
    • H04L67/30—Profiles
    • H04L67/306—User profiles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/4147—PVR [Personal Video Recorder]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/21—Disc-shaped record carriers characterised in that the disc is of read-only, rewritable, or recordable type
    • G11B2220/215—Recordable discs
    • G11B2220/216—Rewritable discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537—Optical discs
    • G11B2220/2562—DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/60—Solid state media
    • G11B2220/61—Solid state media wherein solid state memory is used for storing A/V content
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/90—Tape-like record carriers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/147—Scene change detection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/78—Television signal recording using magnetic recording
    • H04N5/781—Television signal recording using magnetic recording on disks or drums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/78—Television signal recording using magnetic recording
    • H04N5/782—Television signal recording using magnetic recording on tape
    • H04N5/783—Adaptations for reproducing at a rate different from the recording rate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/84—Television signal recording using optical recording
    • H04N5/85—Television signal recording using optical recording on discs or drums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction

Definitions

  • the invention relates to a method and to an apparatus for processing a data stream.
  • the method of the invention can be used within the context of, e.g., reproducing content information from the data stream.
  • US patent 4,649,442 discloses an automatic program selector of a video tape recorder.
  • the recording start signal is a control signal indicating the start of a recorded program.
  • the automatic reproduction of the content upon detection of the signal allows a user to check whether or not the reproduced program is the desired one.
  • the signal is detected in the fast forward (FF) or rewind (REW) mode
  • the magnetic tape is stopped so as to reproduce a beginning portion of the detected program for a predetermined period of time.
  • the FF or REW mode is automatically resumed if the user, during the reproduction of the detected program, makes no key operation.
  • the known selector automatically renders the parts of a program without the intervention of the user, based on the recording start signal.
  • the invention provides, among other things, a method for controUably reproducing pre-recorded content information that allows the user to decide him/herself which portions of the content or of the program are to be reproduced.
  • the invention provides, e.g., a user-friendly method for retrieving a desired sequence or scene within the pre-recorded program.
  • the invention further provides the user with the option of playing out content that starts as closely as possible to a location selected by the user within the content.
  • the invention provides a method for processing a data stream. While the data stream is being processed at a first speed, a command is supplied, e.g., by the user, to change the processing at the first speed to processing at a second speed. The processing at the first speed is stopped. The processing at the second speed is started at a location in the data stream already passed while the stream was previously being processed at the first speed. The location for starting the processing at the second speed is re-adjustable to take into account circumstances examples of which are given below.
  • data stream refers to, among other things, the concept of a linear succession of data.
  • the data stream may be processed in either one of the forward and backward (or rewind) direction.
  • the data stream may be processed at different speeds.
  • the invention allows switching from processing at the first speed to processing at the second speed, while taking into account the desired starting point for starting the processing at the second speed.
  • Processing at the second speed is not necessarily started from the point in the stream where processing at the first speed was interrupted.
  • the inventor has realized that there is a delay between the moment the processing at the first speed is actually stopped, and the moment at which the user actually wanted it to stop when he/she gave the command to switch to the second speed processing.
  • the start point in the stream for the processing at the second speed has typically already been passed while changing from processing at the first to the second speed.
  • the start point in the stream is located in the direction opposite to that of the processing at the first speed.
  • the invention seeks to compensate for this delay.
  • This interval between the stop point and the start point may depend on, among other things, a profile of the user (or: user-history) regarding interaction with the processing apparatus, his/her habits, his/her reaction time, the magnitude of the first speed or on technical features of the apparatus processing the data stream.
  • This interval between the stop point and the start point may be adaptive or even be dynamically, or real-time, adaptive.
  • the invention is used, for example, for the playing out of content information obtained from the processing of the data stream in a recording apparatus such as a video or audio tape recorder, or a HDD-based video recorder such as the one from TiVo or Replay.
  • a recording apparatus such as a video or audio tape recorder, or a HDD-based video recorder such as the one from TiVo or Replay.
  • the user scans content information that is being played-out in a forward direction at a high speed (Fast Forward).
  • the user spots a specific portion while in the Fast Forward mode and decides to resume playing out at normal speed beginning at that specific portion.
  • the user sends a command to the apparatus to stop the fast forward processing.
  • the user intends to stop the Fast Forward processing at the beginning of the specific portion.
  • the start point is determined as mentioned above, upstream of the point where the Fast Forward processing actually stopped.
  • Information content may then be played in the forward direction at a normal speed starting at a data preceding the fast forward stop point. As a result the information content is played-out beginning closely to where the user originally wished to switch from the fast forward mode to the normal playing mode.
  • one or more locations in the data stream have been marked in advance by a respective bookmark pointer.
  • Upon rewinding or Fast Forwarding and then instructing the system to start processing at normal play-out is started at a point indicated by a specific bookmark pointer.
  • This specific bookmark pointer precedes the location where the processing at the first speed was stopped.
  • bookmark pointer is any information that indicates a beginning, and possibly, an ending of a specific scene in the data stream (“bookmark pointer” is also abbreviated to "bookmark”).
  • a bookmark may be a label embedded in the stream or a data item in the stream that can be recognized as such.
  • a bookmark may also be provided separately from the data stream for, in combination with the stream.
  • the bookmarks can indicate beginnings of scenes or sequences in the content information, or the bookmarks indicate portions thereof, for which the user is expected to show or has shown interest.
  • the invention is also useful in a video-on-demand system or audio-on-demand system, wherein a remote server supplies to a client a video or audio stream over a data network.
  • the network latencies between client-server add to the problems indicated above for which the invention provides a solution.
  • the term "latency" refers to the noticeable propagation delay between cause and effect.
  • network latency is a difficult problem to overcome.
  • Today's Internet environment has considerable latency, typically in the order of seconds.
  • High-speed analog modems introduce as much as 30 milliseconds of delay, which means 60 milliseconds end-to-end. Latency effects tend to get more serious with larger size of the network and with increased network load. Eliminating all network latency is impossible.
  • Latency can be determined in various ways.
  • One of the manners is to send a message that takes a round trip between the machines communicating over the network and then divide the round trip time by a factor of two. For example, on a Unix machine connected to the Internet, one can enter "ping -s ⁇ Internet name of a destination machine>" to send a number of round trip packages to the destination machine and obtain the round trip time. This pinging could be done once, e.g., at the initialization of the communication, or at regular time intervals to adapt for the dynamic changes in network congestion. The network latency thus determined is taken into account by the system to determine the jump back in the stream when switching from processing at the first speed to processing at the second speed upon the user issuing the instruction.
  • Fig.1 is a diagram illustrating switching the processing of the data stream from fast forward to normal play
  • Fig.2 is a diagram illustrating switching the processing of the data stream from fast backward (or rewind) to normal play
  • Fig.3 is a diagram of a data stream with bookmark pointers. Throughout the drawing, same reference numerals indicate similar or corresponding features.
  • Fig.4 is a functional block diagram of an end-to-end content delivery system.
  • Fig.5 is a functional block diagram of an interactive end-to-end content delivery system.
  • Fig.l is a diagram that illustrates switching the processing of a data stream 100 from fast forward to normal play.
  • Stream 100 is shown as a linear array, wherein the data are successively being processed from left to right in case of processing in the forward direction (fast forward and normal play-out).
  • Stream 100 is initially processed at first speed 102 in the fast forward mode.
  • first speed 102 When the user gives the command to stop the fast forward processing and begin the normal play out, latencies cause the fast forward processing to overshoot the data at which the user intended to resume normal play-out. Processing at first speed 102 actually stops at a stop point 108. If the normal play-out mode took over at stop point 108, the user would miss the data in overshoot 110.
  • the processing of stream 100 at a second speed 104 is started at a start point 106.
  • start point 106 is upstream of stop point 108.
  • the distance between points 106 and 108 takes into account overshoot 110.
  • a jump backward is needed in the switching of processing stream 100 from first speed 102 to second speed 104.
  • Start point 106 should be the point where the user wants the processing to be started at the second speed 104.
  • the invention comprises determining start point 106.
  • the jump backward is based on overshoot 110 and takes into account, among other things, the reaction time of the user and system latencies.
  • Fig.2 is a diagram that illustrates switching the processing of data stream 100 from rewind to normal play-out.
  • Stream 100 is initially processed at first speed 102 in a fast backward or rewind mode.
  • latencies cause the processing in the rewind mode to overshoot the intended switching point and stop at stop point 108.
  • Processing of stream 100 at the second speed 104 should therefore start at start point 106 that lies upstream, in the rewind mode, of point 108. This requires a jump forward in the normal play-out mode. The jump is based on overshoot 110.
  • Fig.3 is a diagram of data stream 100 provided with bookmark pointers 142, 144, 146 and 148.
  • Pointers 142, 144, 146 and 148 can be created in a variety of ways, examples of which are given below.
  • the bookmark pointers have been added to stream 100 to provide system control signals. The control signals enable the system to find the proper starting point for starting the play-out when switching from fast forward or rewind to the normal play out mode.
  • a first example is based on detecting a start of a new scene (or of new data) in stream 100.
  • data stream 100 comprises a video stream with successive encoded frames
  • bookmark pointers 412, 144, 146 and 148 can point to respective key-frames.
  • key-frame indicates a frame in stream 100 that is a typical representative of part of the content. See for example, published International patent application WO 98/55942, herein incorporated by reference.
  • a simple way of selecting a key-frame is to detect video scene changes in the content information.
  • a key-frame representing a given scene is, for example, the first frame of the scene.
  • a scene can be further analyzed to select a key-frame that is a meaningful representation of the scene.
  • Each scene can then be further investigated to find a key-frame that is a better representation of the scene than the first frame.
  • a second example is based on detecting meta data accompanying stream 100.
  • stream 100 comprises, for example, a video stream with embedded closed caption subtitling meta data.
  • the user has expressed an interest in playing golf as indicated by his/her user profile or history.
  • a bookmark pointer is created pointing to the start of the corresponding scene.
  • a third example is based on detecting a certain object or movement in the content information of stream 100.
  • data stream 100 comprises an episode of a popular TV show. At a certain moment a guest star enters the scene. That particular moment in video stream 100 can get a bookmark.
  • a fourth example is based on detecting a certain sound or word.
  • stream 100 represents a movie with little dialogue. The start of a dialogue can get a bookmark by detecting voice in the movie's audio data stream.
  • a fifth example is based on bookmarks that indicate the content information of a portion of data stream 100, for which the user has shown or is expected to show interest.
  • U.S. Serial no. 09/585,825 (Attorney docket US 000123) filed 6/1/00 for Eugene Shteyn for "Content with bookmarks obtained from an audience's appreciation", incorporated herein by reference.
  • This document relates to a method for providing bookmarks to indicate elements or portions of content information that are likely to be of interest to a person.
  • the creation of the bookmarks is based on, e.g., the appreciation registered while monitoring a test audience.
  • Data stream 100 comprises a video stream and comprises a sequence of GOPs, possibly MPEG2 compressed.
  • the start of a GOP is typically I-frame encoded and is indicted by reference numeral 150.
  • data stream 100 is a compressed video stream, e.g., in MPEG2.
  • the start of a new scene is typically encoded as an I-frame for encoding efficiency reasons.
  • the I-frame is then the first frame of a GOP.
  • the bookmarks can be created by, among others, the producer of the data stream; the data stream provider or broadcaster; the user; or an automated method.
  • the user creates the bookmarks, for example, when he/she spots a desired element in the data stream.
  • the user sends a command, e.g., by means of a remote control, in order to create a bookmark for a location in the data stream corresponding to the desired element. Again, latency and reaction time are to be taken into account by the system when adding the bookmark to the stream.
  • Start point 106 can be a bookmark close to stop point 108.
  • Data stream 100 is preferably stored using a random access memory (RAM) medium, e.g., an optical or magnet disk or a solid state memory.
  • RAM random access memory
  • the RAM minimizes the time it takes to switch from first speed processing of the stream to second speed processing.
  • Examples of data stream 100 and the storage medium are the following: an MPEG2-Stream of compressed movie on a DVD- Video disk; a compressed TV-broadcast stored on an Hard Disk Drive (e.g. TiVo Personal TV); an MP3 compressed audio file in a Flash memory (e.g., the Philips Rush MP3 player).
  • the data stream may also be stored on a non-random-access memory medium, such as a magnetic tape, but, unless some random access buffer memory is available, the switch between first and second processing speed might not be smooth.
  • a bookmark can be part of the data stream structure (e.g., embedded in private data in case of an MPEG stream) or can be kept in a separate data structure (e.g., a table-of-content file of a DVD-movie). In either case, a relevant bookmark is provided before the transition is made from processing at the first speed to processing at the second speed.
  • the relevant bookmark is typically the latest one encountered in the data stream being processed at the first speed.
  • Fig.4 is a functional block diagram of an end-to-end content delivery system 400.
  • System 400 comprises a service / content provider 402, a STB 406, a display & loudspeaker 408, a link 422 between provider 402 and STB 406 over a network 404 and a link 424 between STB 406 and display & loudspeaker 408.
  • Provider 402 can supply content 412 to network 404 through its output to link
  • Provider 402 is, for example, a broadband cable operator, a Direct To Home (DTH) satellite operator or an ISP.
  • Examples of content 412 are a pay-per-view movie, a television broadcast, or a real-networks streamed media clip.
  • Examples of link 422 are a TV-cable, a POTS telephone / xDSL line, a wireless link between a DTH satellite and a parabolic antenna.
  • Examples of network 404 are a cable head-end distribution system, a data network such as the Internet.
  • STB 406 comprises a microprocessor 416, a control interface 418 for the user, a local storage 420, an input for link 422 and an output to link 424.
  • An example of STB 406 is a consumer digital cable receiver box with personal TV functionality.
  • An example of microprocessor 416 is a Philips Trimedia processor. Such a processor is capable of performing tasks such as transport stream de-multiplexing and MPEG2 encoding or transcoding.
  • Examples of local storage 420 are a HDD, a DVD+RW and a Flash memory.
  • User control interface 418 offers the user control over the STB.
  • Storage 420 can contain data with properties as described above with reference to data stream 100.
  • Microprocessor 416 is in control of the processing speed in case the data supplied via link 422 contains data stream 100.
  • Examples of display & loudspeaker 408 are a TV-set and an audio amplifier set. STB 406 and display & loudspeaker 408 typically reside at the end-user's premises.
  • STB 406 and display & loudspeaker 408 can also physically be combined or its components can also be distributed for, e.g., cost or convenience reasons.
  • provider 402 broadcasts a movie called 'Never miss it again' over cable network 404.
  • the user referred to herein as 'Never Home', has programmed STB 406, named 'Philips super TV to record "Never miss it again” because 'Never Home' expects to be away from home during the broadcast.
  • Microprocessor 416 knows when 'Never miss it again' is being broadcast by using data from an EPG and a built-in timer.
  • Microprocessor 416 controls storage 420, a 100 GB HDD, and controls the recording of
  • Data stream 100 in this example 'Never miss it again', resides physically in storage 420 after the broadcast. After 'Never Home' returns to his home he can now search for his favorite scene of 'Never miss it again' via control interface 418.
  • User control 418 offers trick-play control over previously stored data stream
  • Stream 100 could be, for example, a favorite TV-program.
  • user control 418 is able to receive and process remote control (RC) commands.
  • RC commands can include fast-forward (FF) play, fast-backward (FB) play and normal (1 x speed) play of the TV-program.
  • Microprocessor 416 interprets the processed RC commands and processes stored stream 100, the TV program, from the storage accordingly. The result of this will be, e.g., a base-band AV-signal that will be output over link 424, such as an S-video connection, to for instance a TV-set.
  • the inventor also envisioned a user command such as 'go to next bookmark' (or previous bookmark).
  • This command allows the user to play a pre-recorded program from the next bookmarked location onwards. This command is very useful for a busy user when he wishes to quickly scan earlier recorded programs.
  • 'Never home' is only interested in the home-runs of last weekend's baseball play-off. Therefore 'Never home' has instructed 'Philips super TV, using voice controlled input, to bookmark all home-runs. 'Philips super TV uses the closed caption data of the play-off to bookmark the home-runs. 'Never home' now uses 'go to next bookmark' to quickly catch-up for the missed play-off.
  • STB 406 preferably has means for a program upgrade.
  • Fig.5 is a functional block diagram of an interactive end-to-end content delivery system 500.
  • System 500 comprises a service / content provider 502, a STB 506, a display & loudspeaker 408, a link 422 between provider 502 and STB 506 over network 404, an interactive link 520 between provider 502 and STB 506 over network 404 and a link 424 between STB 506 and display & loudspeaker 408.
  • Physically links 422 and 520 can be the same one.
  • Provider 502 can supply content 512 to network 404 through its output to link 422.
  • the examples of provider 402 given above can be the same as for provider 502.
  • Examples of content 412 are the same as for content 512.
  • Microprocessor 510 enables provider 502 to play its content at different speeds.
  • Interactive link 520 can be used to communicate to microprocessor 510 a requested speed for playing content 512.
  • Data stream 100 is part of content 512.
  • STB 506 is similar to STB 416 but has some significant differences. STB 506 can control the play-out speed of data stream 100 although data stream 100 is not physically located in STB 506. Instead, microprocessor 516 remotely controls the play-out speed of data stream 100. Microprocessor 516 communicates this using link 520 which connects to microprocessor 510.
  • provider 502 can be an Internet service provider or a Video On Demand (VOD) provider which allows its content play-out speed to be controlled remotely.
  • VOD Video On Demand
  • provider 502 receives a request for change of play-out speed network latencies in networks 520 and 422 are taken into account. This will be dealt with by microprocessor 510, 516 or 510 and 516 combined.
  • STB 506 could be a thin client STB with space, power and/or cost constraints.
  • a good example of this STB 506 would be that of a Web-pad device which even has display & loudspeaker 408 built in.
  • the user can carry the device to wherever he wants and play-out content wherever he wants.
  • the connection, links 422 and 520 to provider 502 can in this case be a wireless one, for example, based on Home-RF, IEEE802.11 or Bluetooth.
  • Provider 502 could be a home-server at the premises of the user and could in turn be connected to an external content provider (not drawn in Fig. 5).
  • provider 502 could be a remote server using a wireless public network such as GSM or UTMS.
  • STB 506 could for instance 'ping' provider 502 in order to determine network delays.
  • Another method could be, when the user requests changing the play-out speed of data stream 100, to time-stamp the command to request this.
  • system 500 can reside in a microprocessor executable program of STB 506 and/or provider 502.
  • the program can be entered in STB 506 at the moment of production or can be entered at a later stage.
  • STB 506 preferably has means for a program upgrade.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Television Signal Processing For Recording (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)

Abstract

A data stream, representing content information, is being processed for play-out. The processing of the stream is changed from processing at a first speed to processing at a second speed. The first speed is different from the second speed. The processing at the first speed is stopped, and the processing at the second speed is started at a location in the stream that was passed during the processing at the first speed. The location can be re-adjustable.

Description

Method for switching from scanning content to playing the content
FIELD OF THE INVENTION
The invention relates to a method and to an apparatus for processing a data stream. The method of the invention can be used within the context of, e.g., reproducing content information from the data stream.
BACKGROUND ART
US patent 4,649,442 discloses an automatic program selector of a video tape recorder. In the video tape recorder, every time a recording start signal is detected, the corresponding content is automatically reproduced. The recording start signal is a control signal indicating the start of a recorded program. The automatic reproduction of the content upon detection of the signal allows a user to check whether or not the reproduced program is the desired one. Thus, when the signal is detected in the fast forward (FF) or rewind (REW) mode, the magnetic tape is stopped so as to reproduce a beginning portion of the detected program for a predetermined period of time. The FF or REW mode is automatically resumed if the user, during the reproduction of the detected program, makes no key operation.
SUMMARY OF THE INVENTION
The known selector automatically renders the parts of a program without the intervention of the user, based on the recording start signal. The invention provides, among other things, a method for controUably reproducing pre-recorded content information that allows the user to decide him/herself which portions of the content or of the program are to be reproduced. The invention provides, e.g., a user-friendly method for retrieving a desired sequence or scene within the pre-recorded program. The invention further provides the user with the option of playing out content that starts as closely as possible to a location selected by the user within the content.
The invention provides a method for processing a data stream. While the data stream is being processed at a first speed, a command is supplied, e.g., by the user, to change the processing at the first speed to processing at a second speed. The processing at the first speed is stopped. The processing at the second speed is started at a location in the data stream already passed while the stream was previously being processed at the first speed. The location for starting the processing at the second speed is re-adjustable to take into account circumstances examples of which are given below.
The expression "data stream" refers to, among other things, the concept of a linear succession of data. The data stream may be processed in either one of the forward and backward (or rewind) direction. The data stream may be processed at different speeds.
The invention allows switching from processing at the first speed to processing at the second speed, while taking into account the desired starting point for starting the processing at the second speed. Processing at the second speed is not necessarily started from the point in the stream where processing at the first speed was interrupted. The inventor has realized that there is a delay between the moment the processing at the first speed is actually stopped, and the moment at which the user actually wanted it to stop when he/she gave the command to switch to the second speed processing. The start point in the stream for the processing at the second speed has typically already been passed while changing from processing at the first to the second speed. The start point in the stream is located in the direction opposite to that of the processing at the first speed. The invention seeks to compensate for this delay.
This interval between the stop point and the start point may depend on, among other things, a profile of the user (or: user-history) regarding interaction with the processing apparatus, his/her habits, his/her reaction time, the magnitude of the first speed or on technical features of the apparatus processing the data stream. This interval between the stop point and the start point may be adaptive or even be dynamically, or real-time, adaptive.
The invention is used, for example, for the playing out of content information obtained from the processing of the data stream in a recording apparatus such as a video or audio tape recorder, or a HDD-based video recorder such as the one from TiVo or Replay. For example, the user scans content information that is being played-out in a forward direction at a high speed (Fast Forward). The user spots a specific portion while in the Fast Forward mode and decides to resume playing out at normal speed beginning at that specific portion. The user sends a command to the apparatus to stop the fast forward processing. The user intends to stop the Fast Forward processing at the beginning of the specific portion.
However, this desired point is overshot due to latencies mentioned previously if no measures are taken to compensate for the latencies. In the invention, the start point is determined as mentioned above, upstream of the point where the Fast Forward processing actually stopped. Information content may then be played in the forward direction at a normal speed starting at a data preceding the fast forward stop point. As a result the information content is played-out beginning closely to where the user originally wished to switch from the fast forward mode to the normal playing mode.
In an embodiment of the invention, one or more locations in the data stream have been marked in advance by a respective bookmark pointer. Upon rewinding or Fast Forwarding and then instructing the system to start processing at normal play-out is started at a point indicated by a specific bookmark pointer. This specific bookmark pointer precedes the location where the processing at the first speed was stopped.
The term "bookmark pointer", as used herein, is any information that indicates a beginning, and possibly, an ending of a specific scene in the data stream ("bookmark pointer" is also abbreviated to "bookmark"). A bookmark may be a label embedded in the stream or a data item in the stream that can be recognized as such. A bookmark may also be provided separately from the data stream for, in combination with the stream. For example, the bookmarks can indicate beginnings of scenes or sequences in the content information, or the bookmarks indicate portions thereof, for which the user is expected to show or has shown interest.
The invention is also useful in a video-on-demand system or audio-on-demand system, wherein a remote server supplies to a client a video or audio stream over a data network. The network latencies between client-server add to the problems indicated above for which the invention provides a solution. The term "latency" refers to the noticeable propagation delay between cause and effect. In real-time interaction, network latency is a difficult problem to overcome. Today's Internet environment has considerable latency, typically in the order of seconds. High-speed analog modems introduce as much as 30 milliseconds of delay, which means 60 milliseconds end-to-end. Latency effects tend to get more serious with larger size of the network and with increased network load. Eliminating all network latency is impossible. Latency can be determined in various ways. One of the manners is to send a message that takes a round trip between the machines communicating over the network and then divide the round trip time by a factor of two. For example, on a Unix machine connected to the Internet, one can enter "ping -s <Internet name of a destination machine>" to send a number of round trip packages to the destination machine and obtain the round trip time. This pinging could be done once, e.g., at the initialization of the communication, or at regular time intervals to adapt for the dynamic changes in network congestion. The network latency thus determined is taken into account by the system to determine the jump back in the stream when switching from processing at the first speed to processing at the second speed upon the user issuing the instruction.
BRIEF DESCRIPTION OF THE DRAWING The invention is explained in further detail, by way of example, and with reference to the accompanying drawing wherein:
Fig.1 is a diagram illustrating switching the processing of the data stream from fast forward to normal play;
Fig.2 is a diagram illustrating switching the processing of the data stream from fast backward (or rewind) to normal play; and
Fig.3 is a diagram of a data stream with bookmark pointers. Throughout the drawing, same reference numerals indicate similar or corresponding features.
Fig.4 is a functional block diagram of an end-to-end content delivery system. Fig.5 is a functional block diagram of an interactive end-to-end content delivery system.
DETAILED EMBODIMENTS
Fig.l is a diagram that illustrates switching the processing of a data stream 100 from fast forward to normal play. Stream 100 is shown as a linear array, wherein the data are successively being processed from left to right in case of processing in the forward direction (fast forward and normal play-out). Stream 100 is initially processed at first speed 102 in the fast forward mode. When the user gives the command to stop the fast forward processing and begin the normal play out, latencies cause the fast forward processing to overshoot the data at which the user intended to resume normal play-out. Processing at first speed 102 actually stops at a stop point 108. If the normal play-out mode took over at stop point 108, the user would miss the data in overshoot 110. The processing of stream 100 at a second speed 104, here the speed corresponding to the normal play out mode, is started at a start point 106. In the invention, start point 106 is upstream of stop point 108. The distance between points 106 and 108 takes into account overshoot 110. As a result, a jump backward is needed in the switching of processing stream 100 from first speed 102 to second speed 104. Start point 106 should be the point where the user wants the processing to be started at the second speed 104. The invention comprises determining start point 106. The jump backward is based on overshoot 110 and takes into account, among other things, the reaction time of the user and system latencies.
Fig.2 is a diagram that illustrates switching the processing of data stream 100 from rewind to normal play-out. Stream 100 is initially processed at first speed 102 in a fast backward or rewind mode. When the user initiates a request for switching the processing of stream 100 from rewind at speed 102 to normal play out at second speed 104, latencies cause the processing in the rewind mode to overshoot the intended switching point and stop at stop point 108. Processing of stream 100 at the second speed 104 should therefore start at start point 106 that lies upstream, in the rewind mode, of point 108. This requires a jump forward in the normal play-out mode. The jump is based on overshoot 110.
Fig.3 is a diagram of data stream 100 provided with bookmark pointers 142, 144, 146 and 148. Pointers 142, 144, 146 and 148 can be created in a variety of ways, examples of which are given below. The bookmark pointers have been added to stream 100 to provide system control signals. The control signals enable the system to find the proper starting point for starting the play-out when switching from fast forward or rewind to the normal play out mode.
A first example is based on detecting a start of a new scene (or of new data) in stream 100. In case data stream 100 comprises a video stream with successive encoded frames, bookmark pointers 412, 144, 146 and 148 can point to respective key-frames. The expression "key-frame", as used herein, indicates a frame in stream 100 that is a typical representative of part of the content. See for example, published International patent application WO 98/55942, herein incorporated by reference. A simple way of selecting a key-frame is to detect video scene changes in the content information. A key-frame representing a given scene is, for example, the first frame of the scene. A scene can be further analyzed to select a key-frame that is a meaningful representation of the scene. Each scene can then be further investigated to find a key-frame that is a better representation of the scene than the first frame.
A second example is based on detecting meta data accompanying stream 100. Assume that stream 100 comprises, for example, a video stream with embedded closed caption subtitling meta data. Further assume that the user has expressed an interest in playing golf as indicated by his/her user profile or history. Whenever the word 'golf is found in the closed caption subtitling data, a bookmark pointer is created pointing to the start of the corresponding scene. A third example is based on detecting a certain object or movement in the content information of stream 100. For example, data stream 100 comprises an episode of a popular TV show. At a certain moment a guest star enters the scene. That particular moment in video stream 100 can get a bookmark. A fourth example is based on detecting a certain sound or word. For example, stream 100 represents a movie with little dialogue. The start of a dialogue can get a bookmark by detecting voice in the movie's audio data stream.
A fifth example is based on bookmarks that indicate the content information of a portion of data stream 100, for which the user has shown or is expected to show interest. Within this context, reference is made to U.S. Serial no. 09/585,825 (Attorney docket US 000123) filed 6/1/00 for Eugene Shteyn for "Content with bookmarks obtained from an audience's appreciation", incorporated herein by reference. This document relates to a method for providing bookmarks to indicate elements or portions of content information that are likely to be of interest to a person. The creation of the bookmarks is based on, e.g., the appreciation registered while monitoring a test audience.
A sixth example is based on bookmarking the first frame of a GOP (Group Of Pictures). Data stream 100 comprises a video stream and comprises a sequence of GOPs, possibly MPEG2 compressed. The start of a GOP is typically I-frame encoded and is indicted by reference numeral 150. For example, data stream 100 is a compressed video stream, e.g., in MPEG2. In a compressed video stream the start of a new scene is typically encoded as an I-frame for encoding efficiency reasons. The I-frame is then the first frame of a GOP.
The bookmarks can be created by, among others, the producer of the data stream; the data stream provider or broadcaster; the user; or an automated method. The user creates the bookmarks, for example, when he/she spots a desired element in the data stream. The user sends a command, e.g., by means of a remote control, in order to create a bookmark for a location in the data stream corresponding to the desired element. Again, latency and reaction time are to be taken into account by the system when adding the bookmark to the stream.
Start point 106 can be a bookmark close to stop point 108. Data stream 100 is preferably stored using a random access memory (RAM) medium, e.g., an optical or magnet disk or a solid state memory. The RAM minimizes the time it takes to switch from first speed processing of the stream to second speed processing. Examples of data stream 100 and the storage medium are the following: an MPEG2-Stream of compressed movie on a DVD- Video disk; a compressed TV-broadcast stored on an Hard Disk Drive (e.g. TiVo Personal TV); an MP3 compressed audio file in a Flash memory (e.g., the Philips Rush MP3 player).
The data stream may also be stored on a non-random-access memory medium, such as a magnetic tape, but, unless some random access buffer memory is available, the switch between first and second processing speed might not be smooth. A bookmark can be part of the data stream structure (e.g., embedded in private data in case of an MPEG stream) or can be kept in a separate data structure (e.g., a table-of-content file of a DVD-movie). In either case, a relevant bookmark is provided before the transition is made from processing at the first speed to processing at the second speed. The relevant bookmark is typically the latest one encountered in the data stream being processed at the first speed.
Fig.4 is a functional block diagram of an end-to-end content delivery system 400. System 400 comprises a service / content provider 402, a STB 406, a display & loudspeaker 408, a link 422 between provider 402 and STB 406 over a network 404 and a link 424 between STB 406 and display & loudspeaker 408. Provider 402 can supply content 412 to network 404 through its output to link
422. Provider 402 is, for example, a broadband cable operator, a Direct To Home (DTH) satellite operator or an ISP. Examples of content 412 are a pay-per-view movie, a television broadcast, or a real-networks streamed media clip. Examples of link 422 are a TV-cable, a POTS telephone / xDSL line, a wireless link between a DTH satellite and a parabolic antenna. Examples of network 404 are a cable head-end distribution system, a data network such as the Internet.
STB 406 comprises a microprocessor 416, a control interface 418 for the user, a local storage 420, an input for link 422 and an output to link 424. An example of STB 406 is a consumer digital cable receiver box with personal TV functionality. An example of microprocessor 416 is a Philips Trimedia processor. Such a processor is capable of performing tasks such as transport stream de-multiplexing and MPEG2 encoding or transcoding. Examples of local storage 420 are a HDD, a DVD+RW and a Flash memory. User control interface 418 offers the user control over the STB. Storage 420 can contain data with properties as described above with reference to data stream 100. Microprocessor 416 is in control of the processing speed in case the data supplied via link 422 contains data stream 100.
Examples of display & loudspeaker 408 are a TV-set and an audio amplifier set. STB 406 and display & loudspeaker 408 typically reside at the end-user's premises.
STB 406 and display & loudspeaker 408 can also physically be combined or its components can also be distributed for, e.g., cost or convenience reasons. For example, provider 402 broadcasts a movie called 'Never miss it again' over cable network 404. The user, referred to herein as 'Never Home', has programmed STB 406, named 'Philips super TV to record "Never miss it again" because 'Never Home' expects to be away from home during the broadcast. Microprocessor 416 knows when 'Never miss it again' is being broadcast by using data from an EPG and a built-in timer. Microprocessor 416 controls storage 420, a 100 GB HDD, and controls the recording of
'Never miss it again' during the live broadcast. Data stream 100, in this example 'Never miss it again', resides physically in storage 420 after the broadcast. After 'Never Home' returns to his home he can now search for his favorite scene of 'Never miss it again' via control interface 418. User control 418 offers trick-play control over previously stored data stream
100 on storage 420. Stream 100 could be, for example, a favorite TV-program. As an example, user control 418 is able to receive and process remote control (RC) commands. RC commands can include fast-forward (FF) play, fast-backward (FB) play and normal (1 x speed) play of the TV-program. Microprocessor 416 interprets the processed RC commands and processes stored stream 100, the TV program, from the storage accordingly. The result of this will be, e.g., a base-band AV-signal that will be output over link 424, such as an S-video connection, to for instance a TV-set.
The inventor also envisioned a user command such as 'go to next bookmark' (or previous bookmark). This command allows the user to play a pre-recorded program from the next bookmarked location onwards. This command is very useful for a busy user when he wishes to quickly scan earlier recorded programs. As and example, 'Never home' is only interested in the home-runs of last weekend's baseball play-off. Therefore 'Never home' has instructed 'Philips super TV, using voice controlled input, to bookmark all home-runs. 'Philips super TV uses the closed caption data of the play-off to bookmark the home-runs. 'Never home' now uses 'go to next bookmark' to quickly catch-up for the missed play-off. 'Never home' probably appreciates the above as an alternative to a user command such as 'Quick-skip' (jump ahead about one minute in a pre-recorded program) as implemented by Replay in their Personal TV STB offerings. Features described above of system 400 can reside in a microprocessor executable program of STB 406. The program can be entered in STB 406 at the moment of production or can be entered at a later stage. In case the program is entered at a later stage, e.g. through downloading over a network such as the internet, STB 406 preferably has means for a program upgrade.
Fig.5 is a functional block diagram of an interactive end-to-end content delivery system 500. System 500 comprises a service / content provider 502, a STB 506, a display & loudspeaker 408, a link 422 between provider 502 and STB 506 over network 404, an interactive link 520 between provider 502 and STB 506 over network 404 and a link 424 between STB 506 and display & loudspeaker 408. Physically links 422 and 520 can be the same one.
Provider 502 can supply content 512 to network 404 through its output to link 422. The examples of provider 402 given above can be the same as for provider 502. Examples of content 412 are the same as for content 512. Microprocessor 510 enables provider 502 to play its content at different speeds. Interactive link 520 can be used to communicate to microprocessor 510 a requested speed for playing content 512. Data stream 100 is part of content 512.
STB 506 is similar to STB 416 but has some significant differences. STB 506 can control the play-out speed of data stream 100 although data stream 100 is not physically located in STB 506. Instead, microprocessor 516 remotely controls the play-out speed of data stream 100. Microprocessor 516 communicates this using link 520 which connects to microprocessor 510.
For example provider 502 can be an Internet service provider or a Video On Demand (VOD) provider which allows its content play-out speed to be controlled remotely. When provider 502 receives a request for change of play-out speed network latencies in networks 520 and 422 are taken into account. This will be dealt with by microprocessor 510, 516 or 510 and 516 combined.
STB 506 could be a thin client STB with space, power and/or cost constraints. A good example of this STB 506 would be that of a Web-pad device which even has display & loudspeaker 408 built in. The user can carry the device to wherever he wants and play-out content wherever he wants. The connection, links 422 and 520 to provider 502 can in this case be a wireless one, for example, based on Home-RF, IEEE802.11 or Bluetooth. Provider 502 could be a home-server at the premises of the user and could in turn be connected to an external content provider (not drawn in Fig. 5). Also provider 502 could be a remote server using a wireless public network such as GSM or UTMS. When using these types of networks the network delays are to be known. STB 506 could for instance 'ping' provider 502 in order to determine network delays. Another method could be, when the user requests changing the play-out speed of data stream 100, to time-stamp the command to request this.
Features described above of system 500 can reside in a microprocessor executable program of STB 506 and/or provider 502. The program can be entered in STB 506 at the moment of production or can be entered at a later stage. In case the program is entered at a later stage, e.g. through downloading over a network such as the internet, STB 506 preferably has means for a program upgrade.

Claims

CLAIMS:
1. A method for changing processing of a data stream (100) at a first speed (102) to processing the data stream at a second speed (104), wherein: the data stream represents content information; the first speed is different from the second speed; and the method comprises: stopping the processing at the first speed; and starting the processing at the second speed at a start point (106) at a location in the stream passed during the processing at the first speed wherein the location of the start point is re-adjustable.
2. The method of Claim 1 , comprising determining the location of the start point (106), wherein the determining takes into account at least one of the following; a history of a user; a latency of an apparatus; a latency of a network connection; the information content of the data stream.
3. The method of Claim 1 , wherein the start point is indicated by a bookmark (142).
4. The method of claim 3, wherein the bookmark is user-programmable.
5. The method of claim 3, wherein the bookmark has been added by a third party.
6. The method of claim 3 wherein: the content information comprises video; and the bookmark indicates a scene change in the video.
7. The method of claim 3, wherein: the data stream comprises meta data associated with the content information; and the location of the bookmark depends on the meta data.
The method of claim 3, wherein: the content information comprises video; and the bookmark represents an I-frame being a first out of an encoded stream of a
GOP.
9. The method of claim 2, wherein: the content information comprises video; the start point depends on a user profile and on an I-frame in the video being closest to a location where the processing at the first speed has stopped and being a first out of a GOP.
10. The method of claim 1 , wherein the data stream is provided via a data network.
11. An apparatus (106) for enabling a user to switch processing of a data stream at a first speed to processing the data stream at a second speed, wherein: the data stream represents content information; the first speed is different from the second speed; and the apparatus responds to a specific user input by stopping the processing at the first speed and starting the processing at the second speed at a location in the data stream passed during the processing at the first speed wherein the location of the start point is re-adjustable.
12. The apparatus of claim 11 , wherein: the data stream comprises meta data; the apparatus starts the processing of the data stream at the second speed at a location in the stream dependent on the meta data.
13. Content information supplied to a user as a data stream with meta data for enabling the user to switch processing the data stream at a first speed to processing the data stream at a second speed, different from the first speed, and wherein the processing at the second stream is started at a location in the stream passed during the processing at the first speed and determined by the meta data wherein the location of the start point is re-adjustable.
14. A method of enabling a user to receive a data stream via a data network, the method comprising enabling the user to control changing processing of the data stream at a first speed to processing the data stream at a second speed, wherein: the data stream represents content information; the first speed is different from the second speed; and the method comprises: upon a user command stopping the processing at the first speed; and starting the processing at the second speed at a start point at a location in the stream passed during the processing at the first speed wherein the location of the start point is re-adjustable.
15. The method of claim 14, comprising determining the start point based on a latency in the data network.
16. A set of instructions executable under control of a microprocessor and provided for performing at least one of the steps of a method for changing processing of a data stream at a first speed to processing the data stream at a second speed, wherein: the data stream represents content information; the first speed is different from the second speed; and the method comprises: stopping the processing at the first speed; and starting the processing at the second speed at a start point at a location in the stream passed during the processing at the first speed wherein the location of the start point is re-adjustable.
PCT/EP2001/013020 2000-11-08 2001-11-06 Method for switching from scanning the content to playing the content WO2002039450A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP01993928A EP1336176A2 (en) 2000-11-08 2001-11-06 Method for switching from scanning content to playing the content
JP2002541682A JP2004513589A (en) 2000-11-08 2001-11-06 How to switch from scanning content to playing content
KR1020027008767A KR20020071924A (en) 2000-11-08 2001-11-06 Method for switching from scanning content to playing the content

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US71073800A 2000-11-08 2000-11-08
US09/710,738 2000-11-08

Publications (2)

Publication Number Publication Date
WO2002039450A2 true WO2002039450A2 (en) 2002-05-16
WO2002039450A3 WO2002039450A3 (en) 2002-11-14

Family

ID=24855315

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2001/013020 WO2002039450A2 (en) 2000-11-08 2001-11-06 Method for switching from scanning the content to playing the content

Country Status (4)

Country Link
EP (1) EP1336176A2 (en)
JP (1) JP2004513589A (en)
KR (1) KR20020071924A (en)
WO (1) WO2002039450A2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1367588A2 (en) * 2002-05-31 2003-12-03 Microsoft Corporation Review speed adjustment marker
NL1021551C2 (en) * 2001-12-07 2004-07-26 Samsung Electronics Co Ltd Playing optical recording medium by inputting play key, starting timer and executing backward search
EP1542473A1 (en) * 2003-12-04 2005-06-15 Pace Micro Technology PLC Broadcast data system and broadcast data receiver
WO2009034597A1 (en) * 2007-09-10 2009-03-19 Thomson Licensing Video playback
EP2413325A1 (en) * 2010-07-30 2012-02-01 Samsung Electronics Co., Ltd. Audio playing method and apparatus
CN102403009A (en) * 2010-07-30 2012-04-04 三星电子株式会社 Audio playback method and device
US8532458B2 (en) 2004-07-15 2013-09-10 Samsung Electronics Co., Ltd. Picture search method and apparatus for digital reproduction
WO2013138475A1 (en) 2012-03-13 2013-09-19 Tivo Inc. Automatic commercial playback system

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100880962B1 (en) * 2006-12-21 2009-02-03 주식회사 휴맥스 Playback Control Device and Method in Digital Video Recorder

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61172238A (en) * 1985-01-26 1986-08-02 Toshiba Corp Automatic program search device of video tape recorder
JPH1040608A (en) * 1996-07-23 1998-02-13 Sony Corp Video signal reproducing device and operating control method therefor
US5848239A (en) * 1996-09-30 1998-12-08 Victory Company Of Japan, Ltd. Variable-speed communication and reproduction system
US6125229A (en) * 1997-06-02 2000-09-26 Philips Electronics North America Corporation Visual indexing system
EP1183689A1 (en) * 1999-03-30 2002-03-06 Tivo, Inc. System for automatic playback position correction after fast forward or reverse

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL1021551C2 (en) * 2001-12-07 2004-07-26 Samsung Electronics Co Ltd Playing optical recording medium by inputting play key, starting timer and executing backward search
US7849487B1 (en) 2002-05-31 2010-12-07 Microsoft Corporation Review speed adjustment marker
EP1367588A2 (en) * 2002-05-31 2003-12-03 Microsoft Corporation Review speed adjustment marker
EP1542473A1 (en) * 2003-12-04 2005-06-15 Pace Micro Technology PLC Broadcast data system and broadcast data receiver
US8532458B2 (en) 2004-07-15 2013-09-10 Samsung Electronics Co., Ltd. Picture search method and apparatus for digital reproduction
WO2009034597A1 (en) * 2007-09-10 2009-03-19 Thomson Licensing Video playback
US9299388B2 (en) 2007-09-10 2016-03-29 Gvbb Holdings S.A.R.L. Video playback
US9355683B2 (en) 2010-07-30 2016-05-31 Samsung Electronics Co., Ltd. Audio playing method and apparatus
CN102403009A (en) * 2010-07-30 2012-04-04 三星电子株式会社 Audio playback method and device
EP2413325A1 (en) * 2010-07-30 2012-02-01 Samsung Electronics Co., Ltd. Audio playing method and apparatus
WO2013138475A1 (en) 2012-03-13 2013-09-19 Tivo Inc. Automatic commercial playback system
CN104285448A (en) * 2012-03-13 2015-01-14 Tivo有限公司 Automatic commercial playback system
EP2826251A4 (en) * 2012-03-13 2015-11-04 Tivo Inc AUTOMATIC READING SYSTEM USED FOR COMMERCIAL PURPOSES
US9525917B2 (en) 2012-03-13 2016-12-20 Tivo Inc. Automatic commercial playback system
US9826274B2 (en) 2012-03-13 2017-11-21 Tivo Solutions Inc. Automatic commercial playback system
EP3416395A1 (en) * 2012-03-13 2018-12-19 TiVo Solutions Inc. Automatic commercial playback system
EP4250749A3 (en) * 2012-03-13 2023-11-29 TiVo Solutions Inc. Automatic commercial playback system

Also Published As

Publication number Publication date
KR20020071924A (en) 2002-09-13
JP2004513589A (en) 2004-04-30
WO2002039450A3 (en) 2002-11-14
EP1336176A2 (en) 2003-08-20

Similar Documents

Publication Publication Date Title
US20230360677A1 (en) Method and system for performing non-standard mode operations
US8452154B2 (en) Transmitting signals to cause replays to be recorded at a plurality of receivers
KR102013088B1 (en) Systems and methods for enhanced trick-play functions
US6848117B1 (en) Video-on-demand system capable of performing a high-speed playback at a correct speed
US6965724B1 (en) Trick-play modes for pre-encoded video
US7032177B2 (en) Method and system for distributing personalized editions of media programs using bookmarks
JP3355825B2 (en) Broadcast reception recording device
US7836475B2 (en) Video access
JP4448273B2 (en) Broadcast program content control
EP0818111B1 (en) Trick-play modes for pre-encoded video
JP3846671B2 (en) Multimedia storage device and multimedia transmission device
KR20030022288A (en) Video playback device with real-time on-line viewer feedback capability and method of operation
JP2005505204A (en) System and method for reduced playback of recorded video based on video segment priority
US11665403B2 (en) Apparatus, systems and methods for song play using a media device having a buffer
WO2002039450A2 (en) Method for switching from scanning the content to playing the content
WO2003051043A1 (en) Method and system for distributing personalized editions of media programs using bookmarks
JPH0998382A (en) Device and method for reproducing dynamic image information
JP2006261784A (en) Av distributing device and method for determining distribution processing

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): IN JP KR

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

ENP Entry into the national phase

Ref document number: 2002 541682

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: IN/PCT/2002/1041/CHE

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 1020027008767

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2001993928

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020027008767

Country of ref document: KR

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): IN JP KR

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

WWP Wipo information: published in national office

Ref document number: 2001993928

Country of ref document: EP

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载