WO2007008589A2 - Systeme de commande de synchronisation totale de theatre - Google Patents
Systeme de commande de synchronisation totale de theatre Download PDFInfo
- Publication number
- WO2007008589A2 WO2007008589A2 PCT/US2006/026335 US2006026335W WO2007008589A2 WO 2007008589 A2 WO2007008589 A2 WO 2007008589A2 US 2006026335 W US2006026335 W US 2006026335W WO 2007008589 A2 WO2007008589 A2 WO 2007008589A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- control system
- theater
- music
- prompt
- theater control
- Prior art date
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63J—DEVICES FOR THEATRES, CIRCUSES, OR THE LIKE; CONJURING APPLIANCES OR THE LIKE
- A63J1/00—Stage arrangements
Definitions
- This invention is related to better and also automated information and control system for theater, which is used for performances.
- Theater performance such as opera, musical, ballet, concert, drama, require staffs other than performers, who work along with timing of performance. They are lighting engineer, audio mixer, stage mechanics controller, prompter, caption display controller and others. Necessary timing for these work, if expressed in physical time by hour, minute and second, vary for each performance day by day. This variance does not allow usage of scheduler or controller programmed with fixed clock time. They must follow progress on the stage with referring music score or script book. This situation makes it difficult to automate the control and ask such staffs tension to follow up score or script sometimes very precisely.
- Recent electronic keyboard instruments have ability of control lighting using MIDI code. But, usual acoustic instruments have no direct connection to control systems. Following music by means of sound analysis is difficult or unreliable with current state of art.
- This invention aims to automate or semi-automate all these timing related tasks.
- Caption in this invention means display of translated lines for audience, who are not fluent enough with language sung or spoken in performance. Timing of display is critical and operated by staff that can follow score or script. This invention offers timing control of caption.
- Prompter teaches singers lines or words to sing a little before the singers sing them from the small box in front of the stage. Prompt helps singers a lot, because singers sometimes must sings huge volume of lines in a full opera in non-mother language. Current style of prompt are requested clearness and perfect timing. So, only limited number of prompters can do it. This invention offers different and automated way of prompt.
- the objective of this invention is to centralize the function of following up music or performance, so that many performers and staffs get free from following up music or performance.
- the objective includes to provide electronic display of music or lines of words and then to eliminate the use of paper music score or lines of words.
- Related objective of this invention is to provide better way of prompt.
- Further objective of this invention is to provide multi channel interpretation to audience.
- total system includes as many computers as necessary, each of which is accessed from musicians, performers, staffs, or audience through electronic display to see music or lines of words or through earphone to listen to digitally stored voices. All these computers are connected by network.
- One of connected computer called timing master, which carries the function of following up music or performance, delivers real time timing information to all these computers through the network.
- Hierarchical multi means are used. These means are, from low priority to high priority, playback of recorded timing, sound analysis, conductor's tact detection, and direct tapping input. If follow up goes well without tapping input, system is automatic. But, human assistance is necessary until we get robust technique for these automatic following up. Tapping input is operated by a dedicated operator or an alternative orchestra player. With playback of recorded timing, it is not so busy task, because only correction of recorded timing and machine follow up is required. Further more, the invention gives the tool, with which tapping input at only check point marked in the score for this purpose work well. Timing of caption display for audience is pre-designed and stored in caption control computer associated with music timing, expressed by bar and beat numbers. Also, segmented and digitally stored voce of interpretation of lines of words are played back at the pre-designed music timing. Real time music timing used for either caption display or interpretation voice is given from the timing master.
- prompt to the performer is given through computer display with scrolling lines of words. Best place for the display is on the wall of orchestra pit facing to the stage and one side or both sides of the conductor. Because performer looks at the display also can see the conductor, which is necessary.
- the displays can be placed at plural points. These are easy to see from various position and posture of performers. Scrolling is synchronized with musical timing supplied from the timing master. Lines of words are displayed with assigned color for each roll. Display shows not only words but also timing or rest count.
- earphones which are connected wireless to computer, which reproduces digitally recorded and stored voices at the timing specified with music timing also stored in the computer.
- Those earphones used for prompt and interpretation are designed as both voices sent from computers and sound picked at the ear position are mixed, so that listeners feel stereo attendance.
- Control for lighting and stage mechanics can be programmed using musical timing provided from timing master.
- Fig. 1 is an example of network structure of present invention
- Fig. 2 is a flow schematic of program modules and data in the timing master computer
- Fig. 3 is a view from stage showing places of displays for prompt
- Fig. 4 is an example of contents of prompt display
- Fig. 5 is an electronic schematic of earphone device used in present invention.
- Fig. 1 shows computer network in a preferred embodiment of the theater information system.
- Each sub LAN is connected to the main LAN through computer 2a ⁇ 13 a, works as bridge between LANs.
- These bridge computers have their specific function.
- Bridge computer 2a at sub LAN 2 is named as Timing Master. Only this Timing Master in the whole system carries out the function of following up music or performance. The function was task done by each performers and stuffs. Parts of the function may be carried by computers 2b or 2c, which are connected to sub LAN 2. An operator may attend at console of Timing Computer 2a. The operator assists conductor to manage rehearsal or accident at performance, and has audio-visual connection even places are far from each other. In case operator is not available, one of orchestra players operates using foot pedals as he plays his part. So, sub LAN 2 is connected to few computers 4b for orchestra players.
- Timing Master 2a delivers music time to other bridge computers and then bridge computers deliver it to computers connected their sub LANs. Different with physical time expressed by hour, minute, and second, music time is expressed by movement, bar and beat. More detailed timing is expressed with decimal number or fraction number of 1 beat. Time of such as drama, which has not music, is expressed by chapter, section, sentence and phrase numbers. These numbers have to be assigned to each part of script. So, more general term for both music time and time for drama may be performance time. But, for convenience, the words music time is used hereunder. As character of a live performance, music time varies for each performance, day by day. So, follow up of each performance is necessary.
- Sub LANs 3 ⁇ 5 are used for showing music to orchestra players and singers.
- orchestra is divided in two groups corresponding to sub LAN 3 and 4.
- Each one or two players need a display of music.
- each display is part of a computer, which has connected to sub LAN. It has all function in one thin box, and can be set on a stand.
- singers do not see music at opera performance.
- sub LAN 5 is prepared for singers to see at the rehearsal. Music score is shown on the screens using projector.
- Sub LAN 6 and 7 are used for prompt purpose.
- Several computers for displaying prompt are placed around the stage and are connected to sub LAN 6.
- several computers for giving voice prompt to each singer through wireless earphone are connected to sub LAN 7.
- Display and voice are alternative media for prompt. Singers can select their preferable media. Theater has both media available for use.
- Sub LAN 8 and 9 are used to provide caption or interpretation to audience.
- Several computers corresponding to the languages generate character display of translated lines of words, and they are connected to sub LAN 8. Also, several computers corresponding to the languages reproduce digitally recorded voice or synthesize voice, and they are connected to sub LAN 9.
- Sub LAN 10 is connected to group of computers for lighting control. Lighting control during performance is programmed using music time. Tasks at the console are automated and change from direct operation to observation. Music score or script is displayed for each stuff.
- Sub LAN 11 is connected to group of computers for stage control, including operation of lifts, platforms, revolving stage, curtains and such those. Sound mixing is included in this group. Control during performance is programmed using music time. Tasks at the console are automated and change from direct operation to observation. Music score or script is displayed for each stuff.
- Sub LAN 12 is connected to group of computers at attendants' station and shops in lobby and dressing rooms and security office. They show music time and expected time left to take necessary actions.
- Sub LAN 13 is connected to group of workstations for preparation and check of music, prompt and interpretation. Voice recording and editing, music score scanning and recognition are included. Work may be done keeping synchronized to the music time or independently.
- Conductor's console computer 14 is connected to main LAN 1. It has double touch panel display for display of two pages of music score. Music display is gradually updated according to delivered music time. Touch panel is used for specifying restarting point or place related to comment at rehearsal. These operations are sent to Timing Master. Timing Master stops music time then deliver replaced music time. These operation may be done by an assistant operator following conductor's command at Timing Master 2a, which has the same touch panel displays.
- Archive Library computer 15 connected to main LAN 1 stores all data about each music work, which has been edited and compiled at preparation workstations 13b or updated at Timing Master 2a. When work to be performed changes, all data necessary at each computer are provided from this computer.
- Fig. 2 shows construction of Timing Master 2a. It is a computer in the embodiment. So, it shows program modules and data and connection between them. Program modules are drawn with rectangular and data are drawn with rhombus.
- Music structure 21 is description of structure of the music work in time scale. It is sequence of pair of rhythm and noted tempo and bar numbers that the pair continues. Also, repeats and notation of moving tempo are included.
- follow up means mapping from this noted music structure to time intervals of beat actually performed.
- Stored timing 22 is mapped data just mentioned. It is a sequence of interval time between consecutive beats. At first, data is filled at workstations with values calculated from noted tempo. For example, if tempo is 120, value is 0.5 second. Also, notation with words such as Allegro, Andante and Largo are interpreted to numerical value generally used for them.
- Music notes 23 are series of every note to be played in the sequence of music time. It is a computerized expression of music.
- Check points data 24 is newly introduced idea of this invention. It is a series of music time, which is chosen as turning point of tempo, and is marked in the music display. Candidates of check point are such as points where tempo notation are given and points few bars later than these points where tempo are established, or points where soloist plays in free tempo. Check points may be chosen at workstations 13b.
- Operation control program 25 controls start and stop of music time within this computer and also all other computers on LAN 1. It has a console of touch panel display and keyboard to give graphical user interface with an operator, who assists the conductor. The operator specifies music works to be performed or rehearsed so that each data is set up ready to use. In rehearse, operator specify starting point on the score, which is transposed to internal expression of music time and provided to music structure 21 as a reading pointer, also, provided to other computers on LAN 1.
- timer control program 28 sets computer timer with value of the current beat length, which is read from stored timing data 22.
- timer control program 25 sends beat signal to priority handling program 29, and sets computer timer again with the value of next beat length.
- Priority handling program 29 then updates current music time 30 along with physical time it happened, and call distribution program 31 to send out music time to other computers on LAN 1.
- current music time can be updated according to stored timing 22.
- Block 32 shows sound analysis, one of music follow up function.
- Microphone 33 picks up sound and audio input program34 performs analog-digital conversion and buffering of data.
- Sound analysis program 35 detects start timing and tone of music sound.
- Matching program 36 starts when sound analysis program sends detected note. Nearest a few notes detected are bundled and matched with notes from music notes data 23 around current music time, with standpoint of interval between notes and height of notes. If matching gets reasonable match, it send out pair of sound start time and music time in data 23 about the last sound in the bundle.
- priority-handling program 29 handles the event as follows. First, it replaces physical time, kept with current music time 30, by detected value. If timer has not set off, timer is cancelled and is set to next beat length. If timer has set off, timer is reset to beat length again. In both case, delay of detection at sound analysis program 32 is compensated in value for timer setting.
- Sound analysis block 32 may be processed in separate computers 2b on LAN 2, because it requires big computing power. There may be plural such computers corresponding to instrument sections or on stage singers to get more accurate matching result. Even this block is processed outside, output link to priority program 29 is realized same way.
- Block 37 shows tact detection, another follow up function.
- video analysis method is described.
- Video camera 38 picks up motion video image of conductor.
- video input program 39 digitizes and buffer it in memory.
- image analysis program 40 detects position of the end of tact.
- beat position detection program 41 detects rebound point with its physical time happened and make a guess about music time. Detected data is sent to priority handling program 29.
- Priority program handle the event same way as detection by sound analysis block 32.
- Tact detection block 37 may be processed in separate computer 2c on LAN 2.
- Both sound analysis block 32 and tact detection block 37 are option. It can be added to the system when robust detection program becomes available.
- Tap input is the final reliable robust input means. Operator can use ordinal computer mouse 42, foot switch, or some device like these. Any of these input devices can be connected to mouse input program 43, and then to tap input program 44. There are two modes in input operation, detail mode and macro mode.
- Pushing and keep pushing right button of mouse 42 activates detail mode.
- first left button ON action is recorded with physical time, and matched with nearest beat either in past and future. Matched music time and physical time of button ON are used to update current music time 30. And after that every new tap input and its physical time are used to update current music time 30 as time of next beat.
- right button is off, it is in macro mode.
- Left button input in macro mode further classified in two cases. If there is checkpoint within one bar length, ON input is accepted as timing of the checkpoint, and physical time and music time registered with checkpoint are sent to priority handling program 29. If there is no checkpoint around the timing, on input is accepted as timing of first beat of the bar nearest the timing. It is used, when there are gradual difference between music time of inside computer and actual performance, to correct inside music time and get synchronized.
- Priority program 29 update current music time 30 and call distribution program 31. Further it calls stored timing update program 45, when there is tap input. In detail mode, it updates one by one stored timing data23. In macro mode, stored timing update program 45 calculate the ratio of physical time period to summation of beat length of stored timing data22, between now and the nearest past check point. Then the program update data of stored timing data 22 between said two points as well as data between current music time and next check point, to the value multiplied by the ratio calculated. Thus macro mode tap input gets effect to compensate slight difference of tempo around there. When operator does not attend at console 26, designated orchestra player operates two foot pedals taking place of the operator. Input signals come through LAN 2.
- timing master 2a gives updated music time to other computers. These computers on sub LAN 3-5 receive music time and use it to update each music display. It is more than automatic turning page. Using electronic display enables to update music pages gradually, so that music stems corresponding to current playing position, that is music time, and parts front and back with certain range are always displayed on the screen. This means top part of next pages is displayed early enough before playing position reaches the end of page. Also, bottom part of former page remains a little while, when playing position goes top of page. It is not like turn over page, which update whole page at once. This gives players enough time and room to prepare for playing the new page.
- sub LAN 3 is used for string instruments and sub LAN 4 is used for wind and percussion instruments.
- Usual number of computers on each LAN is from 20 to 40. It is possible to divide or join sub LAN according to the speed of sub LAN. Music information for each display, whish are different with instruments, are distributed before performance or rehearsal to each computer.
- Computer for orchestra player assigned to operation of tap input displays his part and piano score of music, which includes checkpoint marks, and connects to two foot pedals.
- This computer has two LAN connections, sub LAN 2 and sub LAN 4.
- Vocal music displays at sub LAN 5 is used for rehearsal. These are large format display set at the audience seats.
- This invention gives two new way of prompt to the performer.
- prompt is given through computer display with scrolling lines of words. Scrolling is synchronized with musical timing supplied from the timing master 2.
- Fig. 3 shows places to set displays for this purpose. It is a view from stage 51 towards audience seats 52. Usual theater has frame 53 and orchestra pit 54. Because orchestra pit is lower than audience floor, there should be a wall 54a. Best place for the prompt display is on the wall of orchestra pit facing to the stage and one side or both sides 58a and 58b of the conductor 55. Because performer looks at the display also can see the conductor 55, whom they must watch frequently, in same time.
- the displays can be placed at plural points, such as on the same wall of orchestra pit but away from the conductor 59a and 59b, or as shown as 61a, 61b and 61c, placed side by side with foot lights 57 in case there is no orchestra pit, as shown as 60a and 60b, near doors 56a and 56b at wings, or as shown as 62a and 62b back side of the frame. These are easy to see when performers are at various positions not in center of stage and in various postures. Each display may be assigned to performers time by time.
- Fig. 4 shows samples of display contents.
- 63a is displayed at 58a and 63b is displayed at 58b.
- Display shows not only words but also timing or rest count.
- 64a, 64b, 64c and 64d are names of rolls, and 65a, 65b, 65c and 65d are prompt of each roll, and scrolled from right to left.
- Each line colored by specific color assigned to the roll all the time, even they move between displays or disappears, so that each roll player can find them easily.
- Lines 66a and 66b show current timing, and stay at same position.
- 67 show bar marks.
- 68 show bar numbers left until words appear, and 69 show beat numbers until start of words.
- Contents of lines of words, notations along with bar numbers are input at workstations 13b. Also assignment of displays to be used for each bars are done at the workstations 13b.
- prompt to the performers are given through earphones, which are connected wireless to computers 7b.
- Each computer can reproduces a few channels of digitally recorded and stored voice segments at the timing specified with music timing stored along with voices.
- One method of recording prompt voices and timing data is do it at rehearsal with wireless connection between professional prompter and performers.
- Projection display device is used for caption. Screen may set above the frame 53. Also, small personal display set at each seat, as seen in cabin of airplane, can be used for multi language translation. Sentences are stored with music time to show. At performance, next stored music time is compared with current music time delivered. When they matched, sentences are displayed. These processes are carried in computers on sub LAN 8.
- Voice signal may be delivered through wireless or wired way.
- theater rents out devices to audience.
- User can tune to preferable channel of language.
- Voice signal of sentences are digitally recorded and stored with music time. And reproduced at specified music time.
- Fig. 5 shows schematic diagram of special earphone used for interpretation for audience and prompt for performer.
- Receiver box 71 has power switch 72, channel change buttons 73 and volume change buttons 74.
- Control circuit transforms these inputs to control signals to tuner 76 and demodulation circuit 77.
- Earphone piece 78 has a microphone 79, which picks up the outer sound, and mixing am 80, which mixes microphone signal and voice signal from receiver box. Output of mixing amp drive speaker 81, so that outer sound can be heard at the same level. User can listen music in natural stere sound and also interpretation or prompt voices at desired level.
- Timing of prompt voices should be very precise. So, timing is specified in decimal numbers. Ther is some amount of delay between actual beat timing and timing of corresponding current music tim 30 detected and generated in Timing Master 2a reaches to reproducing program in computer 7b. BuI it comes with physical time of the beat; so physical time corresponding specified music time fo prompt can be estimated using interpolation at computer 7b.
Landscapes
- Electrophonic Musical Instruments (AREA)
- Circuit Arrangement For Electric Light Sources In General (AREA)
Abstract
La présente invention concerne un système de commande de théâtre permettant de commander des éléments de manière synchronisée avec la représentation qui se déroule, notamment un prompteur destiné aux acteurs, des sous-titres pour les spectateurs, l'éclairage et des installations mobiles. Ce système conserve des temps de représentation interne à venir, exprimés avec une mesure et un rythme, et il modifie ceux-ci pour s'adapter à la représentation sur scène. Des contenus de commande sont stockés avec des données de synchronisation exprimées avec des temps de représentation. Chaque article est placé dans une file d'attente lorsque le temps de représentation interne arrive au moment de données de synchronisation stockées. Un affichage des personnages et un play-back des voix sont disponibles pour le prompteur et les sous-titres. Pour le prompteur, des dispositifs à afficheurs multiples sont placés autour de la scène et attribués dynamiquement aux acteurs.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US69774705P | 2005-07-08 | 2005-07-08 | |
US60/697,747 | 2005-07-08 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2007008589A2 true WO2007008589A2 (fr) | 2007-01-18 |
WO2007008589A3 WO2007008589A3 (fr) | 2007-03-08 |
Family
ID=37637742
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2006/026335 WO2007008589A2 (fr) | 2005-07-08 | 2006-07-07 | Systeme de commande de synchronisation totale de theatre |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2007008589A2 (fr) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105031946A (zh) * | 2015-08-11 | 2015-11-11 | 浙江大丰实业股份有限公司 | 一种舞台声光协调运行系统 |
WO2017188038A1 (fr) * | 2016-04-25 | 2017-11-02 | ヤマハ株式会社 | Procédé de traitement d'informations et dispositif terminal |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002005904A1 (fr) * | 2000-07-17 | 2002-01-24 | Sprout Randy T | Systeme interactif de divertissement de representation theatrale a realite virtuelle |
US6386985B1 (en) * | 1999-07-26 | 2002-05-14 | Guy Jonathan James Rackham | Virtual Staging apparatus and method |
WO2003061285A2 (fr) * | 2001-12-24 | 2003-07-24 | Scientific Generics Limited | Systeme de legendage |
US6696631B2 (en) * | 2001-05-04 | 2004-02-24 | Realtime Music Solutions, Llc | Music performance system |
-
2006
- 2006-07-07 WO PCT/US2006/026335 patent/WO2007008589A2/fr active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6386985B1 (en) * | 1999-07-26 | 2002-05-14 | Guy Jonathan James Rackham | Virtual Staging apparatus and method |
US20020091004A1 (en) * | 1999-07-26 | 2002-07-11 | Rackham Guy Jonathan James | Virtual staging apparatus and method |
WO2002005904A1 (fr) * | 2000-07-17 | 2002-01-24 | Sprout Randy T | Systeme interactif de divertissement de representation theatrale a realite virtuelle |
US6696631B2 (en) * | 2001-05-04 | 2004-02-24 | Realtime Music Solutions, Llc | Music performance system |
WO2003061285A2 (fr) * | 2001-12-24 | 2003-07-24 | Scientific Generics Limited | Systeme de legendage |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105031946A (zh) * | 2015-08-11 | 2015-11-11 | 浙江大丰实业股份有限公司 | 一种舞台声光协调运行系统 |
WO2017188038A1 (fr) * | 2016-04-25 | 2017-11-02 | ヤマハ株式会社 | Procédé de traitement d'informations et dispositif terminal |
JP2017199951A (ja) * | 2016-04-25 | 2017-11-02 | ヤマハ株式会社 | 端末装置 |
US10846150B2 (en) | 2016-04-25 | 2020-11-24 | Yamaha Corporation | Information processing method and terminal apparatus |
Also Published As
Publication number | Publication date |
---|---|
WO2007008589A3 (fr) | 2007-03-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6084168A (en) | Musical compositions communication system, architecture and methodology | |
US7157638B1 (en) | System and methodology for musical communication and display | |
US7297856B2 (en) | System and methodology for coordinating musical communication and display | |
US7649134B2 (en) | Method for displaying music score by using computer | |
US5631433A (en) | Karaoke monitor excluding unnecessary information from display during play time | |
US9601029B2 (en) | Method of presenting a piece of music to a user of an electronic device | |
JP4493604B2 (ja) | 演奏ガイド機能付きカラオケシステム | |
WO2007037068A1 (fr) | Systeme pour ensemble musical | |
JP4174940B2 (ja) | カラオケ装置 | |
JP2004233698A (ja) | 音楽支援装置、音楽支援サーバ、音楽支援方法およびプログラム | |
Dannenberg | New interfaces for popular music performance | |
EP1252619A1 (fr) | Dispositif d'affichage de musique au moyen d'un ou plusieurs postes de travail connectes | |
WO2007008589A2 (fr) | Systeme de commande de synchronisation totale de theatre | |
JP4692189B2 (ja) | 合奏システム | |
JP2007334202A (ja) | カラオケ装置 | |
JP2004144867A (ja) | カラオケ装置における歌唱練習支援システム | |
WO2011060504A1 (fr) | Méthode d'enseignement ou de pratique de la musique, et appareil associé | |
Pestova | Models of interaction: performance strategies in works for piano and live electronics | |
JP2004302232A (ja) | 合唱曲や重唱曲を処理するカラオケ演奏方法およびカラオケシステム | |
JP4161714B2 (ja) | カラオケ装置 | |
JP2001013964A (ja) | 演奏装置及びその記録媒体 | |
JPH065455B2 (ja) | 歌唱指導装置 | |
JP2014191331A (ja) | 楽器音出力装置及び楽器音出力プログラム | |
JP4685226B2 (ja) | 波形再生用自動演奏装置 | |
JP2023116866A (ja) | 情報処理方法、プログラム、および情報処理装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
NENP | Non-entry into the national phase in: |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 06786475 Country of ref document: EP Kind code of ref document: A2 |