Reproduction control data generating apparatus and method of same

Abstract

A reproduction control data generating apparatus for generating reproduction control data containing control commands indicating a method of reproduction of audio and/or video data and menu screen data indicating a menu screen used for designation of a control command at the time of reproduction of the audio and/or video data, comprising an input operation screen displaying means for displaying an input operation screen used for the input operation of a control command and the menu screen data, a control command generating means for generating a control command in accordance with an operation with respect to the displayed input operation screen, a menu screen data generating means for generating menu screen data in accordance with an operation with respect to the displayed input operation screen, and a reproduction control data generating means for generating reproduction control data based on the generated control command and the menu screen data.

Claims

What is claimed is:

1. A reproduction control data generating apparatus for generating reproduction control data indicating a method of reproduction of audio and/or video data, comprising:

an audio and/or video data dividing means for dividing said audio and/or video data into reproduction units which serve as units of reproduction;

a status transition extracting means for extracting a status transition among said divided reproduction units;

a status transition selecting means for selecting a desired status transition from among said extracted status transitions; and

a reproduction control data generating means for generating reproduction control data based on said selected status transition.

2. A reproduction control data generating apparatus as set forth in claim 1, wherein;

said audio and/or video data dividing means groups said divided reproduction units into reproduction groups for every attribute, and

said status transition extracting means extracts said status transition between said divided reproduction units and said grouped reproduction groups.

3. A reproduction control data generating apparatus as set forth in claim 2, wherein said reproduction control data generating means comprises

a control command generating means for generating a control command corresponding to the status transition processing for producing said extracted status transition and

a control command selecting means for selecting a control command corresponding to said selected status transition and

generates reproduction control data containing said selected control command.

4. A reproduction control data generating method for generating reproduction control data indicating a method of reproduction of audio and/or video data, comprising the steps of:

dividing said audio and/or video data into reproduction units which serve as units of the reproduction;

extracting a status transition among said divided reproduction units;

selecting a desired status transition from among said extracted status transitions; and

generating reproduction control data based on said selected status transition.

5. A reproduction control data generating method as set forth in claim 4, wherein;

said divided reproduction units are grouped into reproduction groups according to attribute, and

the status transitions between said divided reproduction units and said grouped reproduction groups are extracted.

6. A reproduction control data generating method as set forth in claim 5, wherein;

the control commands corresponding to the status transition processing for producing said extracted status transition are generated, the control commands corresponding to said selected status transition are selected, and

the reproduction control data containing said selected control commands is generated.

Description

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a reproduction control data generating apparatus for generating control data (navigation commands) used for the control of the processing for reproduction of a moving picture recorded on a digital video disc (DVD) etc. and video data of a still picture (sub-picture) such as a menu which is recorded on the DVD together with the moving picture and used for the selection of the program to be reproduced and relates to a method of the same.

2. Description of the Related Art

A new recording medium referred to as a "digital video disc" (DVD) and a DVD recording and/or reproducing apparatus (hereinafter also referred to as a "DVD player") for recording audio data and video data or one of the same ("audio and/or video data") and reproducing the recorded audio and/or video data by using a DVD are now being put into practical use.

A DVD player can record and reproduce the audio and/or video data in special reproduction modes ("special modes") in addition to the same methods as conventional video tape recorders ("VTR apparatuses") (normal reproduction mode), for example, a method of selecting, reproducing, and displaying one of a plurality of series of audio and/or video data obtained by shooting the same object from a number of angles in accordance with the operation of the user (multi-angle reproduction mode), a method of selecting and reproducing one series of audio and/or video data of a main story of a movie in which a plurality of stories are recorded or a sub-story accompanied with the main story in accordance with the operation of the user (multi-story reproduction mode), and a method of selecting and reproducing from series of audio and/or video data prepared in advance to enable the user to select how a story plays out at every branching point of the story in a dialog format in accordance with the operation of the user (inter-active story reproduction mode).

In order to realize these special reproduction modes, it is necessary to program the order, timing, etc. of reproduction of the audio and/or video data using control commands referred to as navigation commands at the editing stage. Further, it is also necessary to prepare the still pictures (sub-pictures) used for displaying the menu screen, for use by the user for the selection etc. of the audio and/or video data, superimposed on the moving picture (main picture).

There are, however, many types of navigation commands, i.e., about 1,400 at the present point of time. It is very difficult for a general editor, who will not necessarily be skilled in programming work, to learn the meanings of all navigation commands and use them to their fullest extent.

Further, the meanings and number of icons displayed in each sub-picture must be changed in accordance with the nature of the operation, and the icons must be arranged in a manner easy for the user to see. Accordingly, when there are a large number of sub-pictures required in a special reproduction mode, a great deal of time and trouble are taken for the preparation of the sub-pictures.

SUMMARY OF THE INVENTION

The present invention was made in consideration with these disadvantages and has as an object thereof to provide a reproduction control data generating apparatus enabling a general editor who is not skilled in programming work to easily program the order, timing, etc. of the reproduction of audio and/or video data by navigation commands for use in a special reproduction mode of a DVD player and to provide a method of the same.

Another object of the present invention is to provide a reproduction control data generating apparatus enabling easy preparation of the sub-pictures used in the special reproduction modes of a DVD player and to provide a method of the same.

Still another object of the present invention is to provide a reproduction control data generating apparatus capable of greatly reducing the trouble and time required for the preparation of a large number of sub-pictures with different display contents and to provide a method of the same.

To attain the above objects, according to a first aspect of the present invention, there is provided a reproduction control data generating apparatus for generating reproduction control data containing control commands indicating a method of reproduction of audio and/or video data and menu screen data indicating a menu screen used for designation of a control command at the time of reproduction of the audio and/or video data comprising an input operation screen displaying means for displaying an input operation screen used for the operation of input of a control command and the menu screen data, a control command generating means for generating a control command in accordance with an operation with respect to the displayed input operation screen, a menu screen data generating means for generating menu screen data in accordance with an operation with respect to the displayed input operation screen, and a reproduction control data generating means for generating reproduction control data based on the generated control command and the menu screen data.

Preferably, the input operation screen displaying means displays control element command input graphics indicating control element commands comprising a control command on the input operation screen, and the reproduction control data generating means generates a control element command in accordance with an operation with respect to the control element command input graphics.

Preferably, the menu screen contains operation buttons corresponding to the control element commands, and the reproduction control data generating means lists the operation buttons and the control element commands at predetermined positions of the reproduction control data in correspondence in accordance with an operation with respect to the control element command input graphics.

Preferably, a control command contains at least, as the control element commands, pre-command data to be executed first at the time of execution of the control command in accordance with an operation with respect to an operation button of the menu screen, a button command to be executed in accordance with an operation with respect to an operation button of the menu screen, and post-command data to be executed last at the time of execution of the control command.

Preferably, the input operation screen displaying means displays menu screen element data input graphics indicating the menu screen element data comprising the menu screen data on the input operation screen, and the reproduction control data generating means generates the menu screen element data in accordance with an operation with respect to the menu screen element data input graphics.

Preferably, the menu screen contains operation buttons corresponding to the menu screen element data, and the reproduction control data generating means lists the operation buttons and the menu screen element data at predetermined positions of the reproduction control data in correspondence in accordance with an operation with respect to the menu screen element data input graphics.

Preferably, the menu screen data contains at least, as the menu screen element data, pixel data of a still picture of the menu screen, button position data indicating the position of each of the operation buttons and a relative positional relationship, and operation button color data indicating a color where an operation with respect to an operation button is not carried out, a color where an operation with respect to an operation button is carried out, and a color where a control command corresponding to an operation button is executed.

The reproduction control data generating apparatus according to the present invention is used when reproducing for example audio and/or video data such as a movie on a DVD capable of carrying out special reproduction, for example, audio and/or video data edited so that a user can select any reproduction start position, any language of audio output, and any camera angle by carrying out an operation on the menu screen. It generates the control commands (navigation commands) indicating the method of reproduction of the audio and/or video data and the pixel data (sub-picture data) of the menu screen used for the designation of the navigation commands by the user.

The input operation screen displaying means displays an input operation screen (GUI screen) used by the user for the operation for inputting the navigation commands and menu screen data in a dialog format (inter-actively).

On the menu screen, one or more operation buttons indicating commands which can be designated at the time of reproduction are displayed.

Further, a navigation command contains for example pre-command data to be executed first at the time of execution of the command, a button command corresponding to an operation button of the menu screen, and post-command data to be executed last.

Further, the menu screen data contains, for example, the pixel data of the still picture of the menu screen, button position data indicating the positions of the operation buttons and relative positional relationship, and operation button color data indicating colors (highlight colors) at the time of nonselection, time of selection, and case where the corresponding command is executed.

On the GUI screen, control element command input graphics (icons) indicating navigation commands and icons indicating the data of operation buttons etc. comprising the menu screen data (menu screen element data) are displayed. The user designates the data of the navigation commands and the menu screen data by moving a cursor to each icon by a remote controller etc. of the DVD player.

The input operation screen displaying means determines the data of the navigation commands and operation buttons corresponding to the icons designated by the user, stores the operation buttons and navigation commands in a predetermined data structure in correspondence, and generates the reproduction control data.

According to a second aspect of the present invention, there is provided a reproduction control data generating method for generating reproduction control data containing control commands indicating the method of reproduction of audio and/or video data and menu screen data indicating a menu screen used for designation of a control command at the time of reproduction of the audio and/or video data, comprising the steps of displaying an input operation screen used for the operation for input of a control command and menu screen data, generating a control command in accordance with an operation with respect to the displayed input operation screen, generating menu screen data in accordance with an operation with respect to the displayed input operation screen, and generating reproduction control data based on the generated control command and the menu screen data.

According to a third aspect of the present invention, there is provided a reproduction control data generating apparatus for generating reproduction control data indicating a method of reproduction of audio and/or video data comprising an audio and/or video data dividing means for dividing the audio and/or video data into reproduction units which serve as units of reproduction, a status transition extracting means for extracting a status transition among the divided reproduction units, a status transition selecting means for selecting a desired status transition from among the extracted status transitions, and a reproduction control data generating means for generating reproduction control data based on the selected status transition.

Preferably, the audio and/or video data dividing means groups the divided reproduction units into reproduction groups for every attribute, and the status transition extracting means extracts the status transition between the divided reproduction units and the grouped reproduction groups.

Preferably, the reproduction control data generating means comprises a control command generating means for generating a control command corresponding to the status transition processing for producing the extracted status transition and a control command selecting means for selecting a control command corresponding to the selected status transition, and generates reproduction control data containing the selected control command.

This aspect of the present invention enables the preparation of reproduction control data comprised of control commands (navigation commands) used for controlling the order of reproduction of the audio and/or video data for special reproduction of a DVD video disc or the language etc. of the audio by a dialog format (inter-actively) without the editor (user) editing the audio and/or video data to be recorded on the DVD having to directly handle the navigation commands.

The audio and/or video data dividing means divides the audio and/or video data recorded on the DVD into reproduction units which serve as units at the time of reproduction, that is, for example, into individual titles of a plurality of movies etc. recorded on the DVD, into individual ranges of the audio and/or video data to be reproduced in the audio and/or video data of an inter-active story reproduction mode in accordance with a selection operation, and into individual dubbed audio of a large number of languages, and groups the reproduction units having same attributes to prepare reproduction groups.

The status transition extracting means extracts a status transition indicating, for example, whether a certain reproduction unit or reproduction group (status) can be reproduced after other reproduction units or reproduction groups and whether other reproduction units or reproduction groups (status) can be reproduced after this reproduction unit or reproduction group (status) and displays the same to the user.

The status transition selecting means selects only the status transition desired by the user from among all status transitions extracted by the status transition extracting means in accordance with the operation of the user.

The reproduction control data generating means generates the navigation commands which become necessary for producing all status transitions extracted by the status transition extracting means in advance and generates the reproduction control data containing only the navigation commands corresponding to the status transition selected by the status transition selecting means.

According to a fourth aspect of the present invnetion, there is provided a reproduction control data generating method for generating reproduction control data indicating the method of reproduction of audio and/or video data, comprising the steps of dividing the audio and/or video data into reproduction units which serve as units of the reproduction, extracting a status transition among the divided reproduction units, selecting a desired status transition from among the extracted status transitions, and generating reproduction control data based on the selected status transition.

Preferably, the divided reproduction units are grouped into reproduction groups according to attribute, and the status transitions between the divided reproduction units and the grouped reproduction groups are extracted.

Preferably, the control commands corresponding to the status transition processing for producing the extracted status transition are generated, the control commands corresponding to the selected status transition are selected, and the reproduction control data containing the selected control commands is generated.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other objects and features of the present invention will become clearer from the following description of the preferred embodiments given with reference to the attached drawings, wherein:

FIG. 1 is a view of a sub-picture defined in a DVD video disc standard;

FIGS. 2A and 2B are views of an example of a sub-picture (character "+" (cross) with a fringe of a size of 9.times.9 pixels) defined in the DVD video disc standard;

FIG. 3 is a view of an example of an actual chapter menu;

FIGS. 4A to 4C are views of the configuration of data comprised in a menu screen (menu screen data);

FIG. 5 is a view of the configuration of a DVD recording apparatus according to a first embodiment of the present invention;

FIG. 6 is a view of the configuration of a sub-picture encoder of the DVD recording apparatus shown in FIG. 5;

FIG. 7 is a view for indicating coordinates of a rectangular region in which the sub-pictures derived by a control unit of the DVD recording apparatus shown in FIG. 5;

FIG. 8 is a view of the configuration of a menu preparation portion of the DVD recording apparatus shown in FIG. 5;

FIG. 9 is a view of a first GUI image for an index input operation displayed on a CRT display device of an operation terminal by a microprocessor (CPU) shown in FIG. 8;

FIG. 10 is a view of a second GUI image for chapter menu editing displayed on the CRT display device of the operation terminal by the microprocessor shown in FIG. 8:

FIG. 11 is a view of a third GUI image for button layout displayed on the CRT display device of the operation terminal by the microprocessor shown in FIG. 8;

FIG. 12 is a view of a fourth GUI image for pixel data conversion displayed on the CRT display device of the operation terminal by the microprocessor shown in FIG. 8;

FIG. 13 is a view of a fifth GUI image for button/highlight color editing displayed on the CRT display device of the operation terminal by the microprocessor shown in FIG. 8;

FIG. 14 is a flowchart of the menu preparation work carriLed out by using the GUI screens shown in FIG. 9 to FIG. 13 and the processing of the same.

FIG. 15 is a flowchart of the menu preparation work carried out by using the GUI screens shown in FIG. 9 to FIG. 13 and the basic processing of the same.

FIGS. 16A to 16C are views of the reproduction processing of the inter-active software;

FIG. 17 is a flowchart of an example of the reproduction processing of the inter-active software;

FIG. 18 is a view of examples of a reproduction unit and reproduction group (reproduction region);

FIGS. 19A to 19C are views of examples of the menu screen of a multi-title multi-audio software;

FIG. 20 is a table indicating the reproduction units and reproduction groups (reproduction regions) contained in the multi-title multi-audio software shown in FIGS. 19A to 19C;

FIG. 21A is a view of a system register for storing set values of a DVD player;

FIG. 21B is a view of a general register;

FIG. 22 is a view of examples of the operations of a DVD player for reproducing the multi-title multi-audio software corresponding to the menu screens shown in FIGS. 19A to 19C;

FIG. 23 is a view of examples of the operations of the DVD player for reproducing the multi-title multi-audio software corresponding to the menu screens shown in FIGS. 19A to 19C;

FIG. 24 is a view of examples of the status transitions of the DVD player for reproducing the multi-title multi-audio software corresponding to the menu screens shown in FIGS. 19A and 19B:

FIG. 25 is a first view indicating command units corresponding to the status transitions of a reproduction group "Title Selection" shown in FIG. 24;

FIG. 26 is a second view indicating command units corresponding to the status transitions of a reproduction group "Audio Selection" shown in FIG. 24;

FIG. 27 is a view of examples of the status transitions (FIG. 24) selected by the user;

FIGS. 28A and 28B are flowcharts of the reproduction processing derived from the status transition selected by the user;

FIGS. 29A to 29D are views of the command units (navigation commands) generated based on the selected status transition (FIG. 27);

FIG. 30 is a view of an example of the configuration of an intermediate file recorded in a hard disc drive (FIG. 8) of a sub-picture encoder (FIG. 5) in a third embodiment; and

FIG. 31 is a flowchart of an example of the entire operation of the sub-picture encoder in the third embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

First Embodiment

Below, as a first embodiment, an explanation will be made of for example a digital video disc (DVD) recording apparatus for recording video data of a moving picture such as a movie edited so as to be suitable for the special reproduction mode (hereinafter, also provisionally referred to as a "main picture") and audio data and one of the same (audio and/or video data) together with images such as menu screens indicating the content of operations to the user or subtitles (hereinafter also provisionally referred to as "sub-pictures") on a DVD.

Explanation of Sub-Picture

First, an explanation will be made of a sub-picture as defined in the DVD video disc standard (DVD format).

The DVD video disc standard defines the format of a still picture (sub-picture) displayed superimposed on a main picture separate from the compressed video data (main picture) of a moving picture compressed and encoded by the MPEG (Moving Picture Experts Group) 2.

FIG. 1 is a view of a sub-picture defined in the DVD video disc standard.

In the DVD video disc standard, as shown in FIG. 1, a sub-picture is defined as 2 bits of pixel data inherently assigned to each of the pixels obtained by dividing a picture (frame) into lateral 720.times.vertical 478 pieces (case of NTSC video system). That is, a sub-picture is defined in the form of a bit map corresponding to the pixels of a picture.

The values (0 to 3 (decimal)) of the 2 bits of pixel data assigned to each of the pixels respectively correspond to inherent colors. Accordingly, four types of colors can be assigned to each of the pixels of a sub-picture.

Note that, in actuality, any four colors are selected from a color pallet comprised of 16 types of colors and are used as the four types of colors assigned to each pixel of the sub-picture.

Further, to which of values (0 to 3) of the pixel data the selected four types of colors correspond and with which ratio the sub-picture and the main picture serving as the background are superimposed (for example, if the sub-picture is given a ratio of 0 percent and the moving picture is given a ratio of 100 percent, the sub-picture becomes transparent and cannot be seen. Further, if they are given in ratios of 50 percent and 50 percent, the sub-picture becomes semi-transparent and if they are given in ratios of 100 percent and 0 percent, the moving picture part at the background is completely hidden) are determined according to a separately provided table setting the same.

FIGS. 2A and 2B are views of an example of a sub-picture defined in the DVD video disc standard, specifically, a character "+" (cross) with a fringe of a size of 9.times.9 pixels.

For example, as shown in FIG. 2A, there are three colors required for a sub-picture displaying a "character "+" (cross) with a fringe" of a size of 9.times.9 pixels, i.e., a color of the background, a color of the body of the character "+" (cross), and a color fringing the body of the character "+".

If the pixel data 00 is used to indicate the color of the background, the pixel data 11 is used to indicate the color of the body of the character "+", and the pixel data 10 is used to indicate the color of the fringe, as shown in FIG. 2B, a set of 9.times.9 pixel data can be obtained. By finding this pixel data for all of the 720.times.478 pixels comprising one picture, one picture's worth of a DVD sub-picture can be obtained.

Further, for example, by placing the pixel data of letters and graphics in a region near the bottom in the region of the 720.times.478 pixels, placing the pixel data of the background in the other parts, and further controlling the ratio of mixing of the pixel data of the background with respect to the main picture to 0 percent, a transparent sub-picture displaying the letters and graphics at only the bottom of the picture and displaying the background as it is in all other parts can be generated.

In the DVD video disc standard, for example, the subtitless of a movie are shown by using the sub-picture in this way.

Explanation of Navigation Commands

Next, the navigation commands of the DVD video disc standard will be explained.

In the DVD video disc standard, a programming language referred to as navigation commands is prepared in order to control the method of reproduction by the DVD player. A program written by the navigation commands is recorded on the DVD together with the audio and/or video data. The DVD player reproduces the audio and video according to the order of the reproduction and timing indicated by the program written by the navigation commands.

In the DVD video disc standard, a plurality of audio channels can be recorded on the DVD in multiplexed manner. The program comprised by the navigation commands can for example designate which of a plurality of audio channels should be selected and reproduced by the DVD player. Further, the program comprised by the navigation commands can directly designate the start of the reproduction of the video data from the beginning of a highlight scene of the video data of the movie or a specific chapter indicating a break in a story to the DVD player.

These are examples of the operations of programs comprised of the simplest navigation commands.

There are also operations of programs comprised of more complex navigation commands.

For example, it is possible to prepare video data (software) which enables selection of the reproduction video in the form of a dialog (inter-actively), for example, displaying a still picture (sub-picture) posing a question to the viewer at the point of the end of reproduction of a certain chapter and deciding on the chapter from which the reproduction is to be started next in accordance with the answer of the viewer with respect to this question.

This inter-active reproduction mode is used when reproducing video data of a so-called "multi-story/multi-ending" work (a piece of work having a high game-like element in which there is a choice of A or B for every pause of scene and the next scene is determined by the result thereof).

Explanation of Menu Screen

When reproducing software for an inter-active reproduction mode such as the multi-story/multi-ending work mentioned above, a question and answer screen used for the DVD player displaying a question to the viewer (user) and carrying out an operation according to the response of the-user to the displayed question becomes necessary. This question and answer screen (menu screen) is by its nature suited for display as a still picture. Accordingly, as the question and answer screen, the above sub-picture is used.

The inter-active operation with respect to the DVD player (inter-active operation) is usually not directly carried out by the user depressing the operation buttons of a remote controller or the like, but is realized by indirectly selecting operation buttons displayed by the DVD player as icons on the menu screen by using a cursor key or the like provided on the remote controller. By such an indirect selection of operation buttons, it is possible to provide software which is not restricted to the functions of buttons inherent in the hardware of the DVD player and which is therefore suited for a variety of inter-active reproductions (inter-active software).

Note that, among the menu screens for the inter-active reproduction, the basic one is defined as the DVD system menu in the DVD video disc standard. This DVD system menu is a sub-picture which is called up by the user himself operating a "menu button", which is prescribed as having to be provided on the remote controller of the DVD player, when the DVD player reproduces the audio and/or video data from a DVD. The user can designate various reproduction patterns of the inter-active software by selecting the operation buttons displayed in the DVD system menu by using a cursor key, which also is prescribed as having to be provided on the remote controller of the DVD player according to the DVD video disc standard.

The DVD video disc standard provides for the DVD system menu as shown below.

1. Title Menu

The title menu is used by the user to designate which title of the audio and/or video data to reproduce when audio and/or video data of a plurality of titles (movies or animation stories) are recorded on a DVD.

2. Chapter Menu

The audio and/or video data of one title (one "movie" in the case of movies or one "album" in the case of music videos (video clips)--usually referred to as a "work") contains inherent internal breaks (changes in the case of movies, breaks in music in the case of video clips, and other breaks where the producer of the recording company desires to start something from the standpoint of the work). As explained above, these breaks are referred to as "chapters". The chapter menu arranges operation buttons for directly starting chapters on the screen.

3. Audio Menu

The audio menu is used by a user for selecting, for example, which audio to listen to when a plurality of audio channels are provided for each of the titles of the video data recorded on the DVD, for example, where the audio of the original language (original audio) and dubbed audios of a number of languages are provided for the video data of a movie.

The audio menu arranges operation buttons to which names of selectable languages are appended on the screen independently for all of the audio channels.

4. Subtitle Menu

The subtitle menu is used by a user for selecting which among a plurality of subtitles should be displayed or if not to display a subtitle when a plurality of subtitles are provided for a title recorded on the DVD.

The subtitle menu arranges operation buttons appended with names indicating the selectable subtitles on the screen independently for all of the subtitles.

5. Angle Menu

The "angle" is a function unique to the DVD video disc standard. For example, when recording a soccer match, usually a plurality of cameras are used. These cameras simultaneously film the game from different camera angles in parallel. That is, for example, the video data of a soccer game will contain data obtained from a camera shooting the entire game from a long perspective, data obtained from a camera following the offense side players in close-up, and data obtained from a camera following the defense side player in close-up.

The plurality of video data obtained by simultaneously shooting an object from a plurality of camera angles in parallel in this way are multiplexed and recorded on the DVD. The reproduction mode which enables a user to select which of the camera angles of the video data shot to reproduce is called the "multi-angle reproduction mode" as mentioned above.

The angle menu arranges operation buttons on which names etc. of selectable angles are appended on the screen independently for all of the angles.

6. Root Menu

The above five types of menus are determined in the DVD video disc standard. However, five operation buttons for displaying the five types of menus are not always provided on the remote controller of a DVD player. The DVD video disc standard only requires provision of two operation buttons, that is, an operation button for calling up the title menu and an operation button for calling up one of the other menus.

Accordingly, where the title to be reproduced requires one or more of the chapter menu, audio menu, sub-picture menu, and angle menu, a special menu screen used for calling up these menus becomes necessary.

The root menu is used when one or more of the chapter menu, auidio menu, sub-picture menu, and angle menu are necessary. The root menu arranges operation buttons appended with names of the chapter menu, audio menu, sub-picture menu, and angle menu individually.

FIG. 3 is a view of an example of an actual chapter menu.

As shown in FIG. 3, on the chapter menu screen, three types of operation buttons of, for example, operation buttons a for designating chapter, operation buttons b for switching the menu, and operation buttons c for a switching menu pages are arranged.

When preparing (authering) such a chapter menu, it is necessary to prepare the pixel data corresponding to the operation buttons according to the sub-picture format of the DVD video disc standard and, also, to establish correspondence between the prepared operation buttons and the navigation commands of the program for controlling the reproduction of the audio and/or video data.

Explaining this establishment of correspondence by using the terminology of the DVD video disc standard, this is done by using the data TT DOMAIN NUMBER x and data PTT NUMBER y of the table TT_SRPT indicating the sector address at the point of time of the start of the recording on the DVD of the chapter (scene 6: fight 1) of the audio and/or video data to generate a binary code of the navigation command JumpPTT (TT=x, PTT=y) and entering this at a position corresponding to BTN_POSI of BTINT in HLI of PCI indicating the position of the operation buttons d (FIG. 3) of scene 6:fight 1 in the screen in the table contained in the button command BTN_CMD (type of navigation command).

Below, an explanation will be made of the relationship between the menu screen and data.

FIGS. 4A to 4C are views of the configuration of the data comprising the menu screen (menu screen data). Note that the menu screen data is actually further divided into smaller units, but for the simplification of the illustration and explanation, in FIGS. 4A to 4C, only parts necessary for the explanation of the DVD recording apparatus according to the present invention are shown. Further, among the reference symbols attached to the data, N.sub.1 to N.sub.3 indicate data of navigation commands and S.sub.1 to S.sub.10 indicate the menu screen data.

The configuration of the data comprising the above six types of menu screens (title menu, chapter menu, audio menu, sub-picture menu, angle menu, and root menu) (menu screen data) is as shown in FIGS. 4A to 4C.

The program chain PGC (Program Chain) (FIG. 4A) has meaning as the framework of one menu screen. It contains all menu screen data and indicates the unit of reproduction of the menu screen and the audio and/or video data of the titles of the movies etc. in the DVD player.

Note that there are cases where one menu screen will be comprised of a number of pages. Irrespective of the number of pages comprising the menu, however, one program chain PGC corresponds to one menu. That is, for example, there are six program chains PGC corresponding to the six types of menus (menus each comprised of a plurality of pages). Further, when one menu screen is comprised by a plurality of pages, the internal portion of the program chain PGC is divided into a plurality of units referred to as "cells".

In order to compose one menu screen, it is necessary to write all of the data contained in the data structure shown in FIGS. 4A to 4C. Below, an explanation will be made of each data contained in the program chain PGC.

Precommand PRE_CMD (N.sub.1 of FIG. 4A)

The pre-command PRE_CMD writes the navigation command to be executed first when the reproduction of one menu screen (program chain PGC) starts (mainly command for initialization of parameters necessary for execution of the button command BTN_CMD (N.sub.3 of FIG. 4C)).

Access unit ACCESS_UNIT (S.sub.1 of FIG. 4A)

The access unit ACCESS_UNIT stores the data (pixel data and color data) of sub-picture (FIG. 1 and FIGS. 2A and 2B) of the menu screen and contains sub-picture pixel data (S.sub.3 of FIG. 4B) and button color data BTN_COLOR (S.sub.4 of FIG. 4B) as shown in FIG. 4B.

Highlight information data HLI (S.sub.2 of FIG. 4A)

When the user selects an operation button of the menu screen by using the cursor key etc. of the remote controller, the DVD player changes the color of the selected operation button. The processing for changing the color of the selected operation button in this way will be referred to as "highlight processing". The highlight information data HLI stores the color data used for the highlight processing and contains highlight color data (Highlight COLOR S.sub.5 of FIG. 4B) indicating the colors before and after the execution of the highlight processing (highlight colors), a relative positional relationship of the operation buttons in the menu, adjacent information between buttons necessary for the selection of the operation button by the cursor key of the remote controller of the DVD player, and button information data BTN_INFO (S.sub.6 of FIG. 4B) indicating the navigation command corresponding to the operation button.

Post-command POST_CMD (N.sub.2 of FIG. 4A)

In the post-command POST_CMD, the navigation command to be executed last (mainly jump command for jumping to the destination of the branch determined by the parameter obtained as the result of execution of the button command BTN_CMD (N.sub.4 of FIG. 4C)) is written at the end of reproduction of the video data of the title corresponding to one menu screen (program chain PGC).

Sub-picture pixel data (S.sub.3 of FIG. 4B)

The sub-picture pixel data stores the data of the sub-picture (FIG. 1 and FIGS. 2A and 2B) used as the menu screen. Note that when the menu screen is comprised by a plurality of pages, a plurality of series of sub-picture pixel data are provided corresponding to the plurality of pages. Further, as mentioned above, the sub-picture pixel data is a constituent element of the access unit ACCESS_UNIT.

Button color data BTN_COLOR (S.sub.4 of FIG. 4B)

The button color data BTN_COLOR stores the data indicating the color palette referred to by the color information when the operation button is not highlighted (time of nonselection) and the color information when the operation button is highlighted (time of selection). Note that, as mentioned above, the button color data BTN_COLOR is a constituent element of the access unit ACCESS_UNIT.

Highlight color data (S.sub.5 of FIG. 4B)

The highlight color data stores the color information used for the highlight processing of the operation button. This color information is not information as to the actual color of the operation button, but contains pointers to the color palette indicated by the button color data BTN_COLOR. It contains the highlight color at the time of selection of the operation button and the highlight color at the time of execution of the button command BTN_CMD. Note that, as mentioned above, the highlight color data is a constituent element of the highlight color data HLI and contains the selection color data SELECT_INFO (S.sub.7 of FIG. 4C) and the action color data ACTION_COLOR (S.sub.8 of FIG. 4C).

Button information data BTN_INFO (S.sub.6 of FIG. 4B)

The button information data BTN_INFO stores the relative positional relationship of the operation buttons in the menu screen, adjacent information between buttons which becomes necessary when changing the selection of a button by the cursor key of the remote controller of the DVD player, and the navigation commands at the time of execution accompanying the operation buttons and plays a central role as the portion for describing the functional logic of the operation buttons of the menu screen. Note that, as mentioned above, the button information data BTN_INFO is a constituent element of the highlight color data HLI and contains button position data BTN_POSITION (S.sub.9 of FIG. 4C), adjacent button data ADJ_BTN (S.sub.10 of FIG. 4C), and a button command BTN_CMD (N.sub.3 of FIG. 4C).

Selection color data SELECT_COLOR (S.sub.7 of FIG. 4C)

The selection color data SELECT_COLOR stores the pointer to the color palette of the highlight color at the time of selection of an operation button.

Action color data ACTION_COLOR (S.sub.8 of FIG. 4C)

The action color data ACTION_COLOR stores the pointer to the color palette of the highlight color at the time of execution of an operation button (the time when the button command BTN_CMD is executed by the DVD player and the time immediately after the execution). Note that, as mentioned above, the action color data ACTION_COLOR is a constituent element of the highlight color data.

Button piosition data BTN_POSITION (S.sub.9 of FIG. 4C)

The relative position of the operation buttons in the menu screen is expressed by the coordinates of the pixels of the operation buttons. The button position data BTN_POSITION stores the top left and bottom right coordinates of the logical display region of the operation buttons, set as rectangles, and the pointers to the color palette (of data BTN_COLOR) of the color information at the time of nonselection of the operation buttons Note that, in one menu screen, irrespective of the number of the operation buttons, there is only one type of color indicating nonselection. Further, as mentioned above, the button position data BTN_POSITION is a constituent element of the button information data BTN_INFO.

Adjacent button data ADJ_BTN (S.sub.10 of FIG. 4B)

The adjacent button data ADJ_BTN stores the adjacent information between buttons--which becomes necessary at the time of selection of an operation button using the cursor key of the remote controller of the DVD player. Note that, as mentioned above, the adjacent button data ADJ_BTN is a constituent element of the button information data BTN_INFO.

Button command BTN_CMD (N.sub.3 of FIG. 4C)

The button command BTN_CMD stores the navigation command at the time of execution of an operation button and directly defines the function of each of the operation buttons. Note that, as mentioned above, the button command BTN_CMD is a constituent element of the button information data BTN_INFO.

As mentioned above, there are 1,400 or more types of navigation commands. In addition, in order to carry out programming using the navigation commands, it is necessary for an editor to be well versed in the meaning of all of the navigation commands and the contents of the DVD video disc standard. Accordingly, it is very difficult for a general editor to carry out the programming using the navigation commands.

Further, as shown in FIGS. 4A to 4C, there are many types of data necessary for preparing the sub-picture pixel data used as the menu screen, and it is very troublesome to prepare all of these data for every menu screen. Accordingly, if the pixel data of the sub-picture can be systematically prepared, the efficiency of the editing work would be improved and it would become possible to shorten the working time.

An object of the DVD recording apparatus 1 (FIG. 5 etc.) according to the present invention explained below is to use an encoder provided exclusively for the menu screen (for example a sub-picture encoder 2 shown in FIG. 5) and carry out software control of the flow of the logic of the constituent elements of the encoder by computer so as to eliminate the difficulty of and simplify programming using navigation commands and the preparation (authering) of a menu screen (sub-picture pixel data).

Further, another object of the DVD recording apparatus 1 according to the present invention is to provide a user friendly environment in which an editor can efficiently carry out programming using navigation commands and prepare sub-pictures of the menu screen in a short time in a dialog format by specially modifying the contents of the operation screen displayed by the computer and the display method.

Configuration of DVD recording apparatus 1

FIG. 5 is a view of the configuration of the DVD recording apparatus 1 according to a first embodiment of the present invention.

As shown in FIG. 5, the DVD recording apparatus 1 is constituted by a video encoder 100, an audio encoder 102, a sub-picture encoder 2, an operation terminal 200, a menu preparation portion 3, an operation terminal 300 having a CRT display device 302 and an input device 304 having a keyboard and a mouse, a multiplex control portion 104, a multiplexing portion 106, a recording device 108, and an editing device 4.

The DVD recording apparatus 1 generates compressed audio and/or video data (main picture) obtained by compressing and coding noncompressed audio and/or video data of a moving picture such as a movie by the MPEG (Moving Picture Experts Group) 2 system and the sub-picture of a still picture such as a menu screen to be displayed superimposed on this compressed video data, multiplexes the same, and records the resultant data on for example a DVD 110 by these constituent parts according to the DVD video disc standard.

Explanation of constituent parts of DVD recording apparatus 1

Below, the operation of the constituent parts of the DVD recording apparatus 1 (FIG. 5) will be explained.

Editing device 4

The editing device 4 controls the constituent parts of the DVD recording apparatus 1 according to the operation of the editor (user) to carry out the editing of the main picture and sub-picture.

Multiplex control portion 104

The multiplex control portion 104 controls the operation of the constituent parts of the DVD recording apparatus 1 based on data such as the time code input from the video encoder 100, audio encoder 102, sub-picture encoder 2, and menu preparation portion 3 and the operation data input to the operation terminal 200 or the operation terminal 300 by the user.

Video encoder 100

The video encoder 100 compresses and codes the noncompressed moving picture video data input from a digital video tape recorder apparatus (VTR apparatus, not illustrated) connected to for example the DVD recording apparatus 1 by the MPEG2 system under the control of the multiplex control portion 104 to generate the compressed video data (main picture) of the moving picture and outputs the same to the input terminal a of the multiplexing portion 106.

Audio encoder 102

The audio encoder 102 compresses and codes the noncompressed audio data input from a digital VTR apparatus connected to for example the DVD recording apparatus 1 by the MPEG2 system under the control of the multiplex control portion 104 to generate the compressed audio data and outputs the same to the input terminal b of the multiplexing portion 106.

Multiplexing portion 106

The multiplexing portion 106 multiplexes either of the compressed video data input from the video encoder 100 to the input terminal a, the compressed audio data input from the audio encoder 102 to the input terminal b, and the data input from the sub-picture encoder 2 and the menu preparation portion 3 to the input terminals c and d (sub-picture pixel data (FIG. 3), navigation commands, and the menu screen data (FIGS. 4A to 4C)) according to the DVD video disc standard under the control of the multiplex control portion 104 to generate a DVD bit stream and outputs the same to the recording device 108.

Recording device 108

The recording device 108 records the DVD bit stream input from the multiplexing portion 106 on the DVD.

Sub-picture encoder 2

FIG. 6 is a view of the configuration of the sub-picture encoder 2 of the DVD recording apparatus 1 shown in FIG. 5.

FIG. 7 is a view of the coordinates indicating a rectangular region in which the sub-picture derived by the control portion 24 of the DVD recording apparatus 1 shown in FIG. 5 exists.

As shown in FIG. 6, the sub-picture encoder 2 is constituted by a quantization portion 20, a coding circuit 22, the control portion 24, and a hard disc drive 240.

The quantization portion 20 is constituted by a time code generation circuit (TCG) 202, an analog/digital conversion circuit (A/D conversion circuit) 204, a selector circuit (SEL) 206, and a quantization circuit (Q) 20.

The coding circuit 22 comprises by a variable length coding circuit (VLC) 220, a decoding circuit (IVLC) 222, and an adder circuit 224.

The sub-picture encoder 2 quantizes the video signal of the sub-picture of the analog format input from an analog VTR apparatus (not illustrated) connected to an external device etc. or a luminance signal of the video data of the 8-bit digital format input from the VTR apparatus or the computer connected to an external device (both not illustrated) to quadrary values (2 bits; 00d, 01d, 10d, and 11d) so as to be suitable as the pixel data (FIG. 1 and FIGS. 2A and 2B) of the sub-picture of the DVD video disc standard, variable length encodes the pixel data of the quantized sub-picture, outputs the same to the input terminal c of the multiplexing portion 106, and, at the same time, decodes the pixel data of the variable length encoded sub-picture, superimposes the same on the video data of the moving picture serving as the background (main picture), and displays the same on the monitor device of the operation terminal 200 to indicate it to the editor (user) by these constituent parts.

In the sub-picture encoder 2, the A/D conversion circuit 204 converts the luminance signal of the video data of the analog format input from the external device to the digital format and outputs the same to the input terminal b of the selector circuit 206.

The selector circuit 206 selects either of the luminance signals of the video data of the digital format input from the external device and the A/D conversion circuit 204 to the input terminals a and b and outputs the same to the quantization circuit 208.

The quantization circuit 208 quantizes the luminance signal of the video data of the 8-bit digital format input from the selector circuit 206, for example, the range of the value of the luminance signal from 0 to 63 (00h to 3Fh), to the value 0 (00) of the pixel data, the range of the value of the luminance signal from 64 to 127 (40h to 7Fh) to the value 1 (01) of the pixel data, the range of the value of the luminance signal from 128 to 191 (80h to BFh) to the value 2 (10) of the pixel data, and the range of the value of the luminance signal from 192 to 255 (C0h to FFh) to the value 3 (11) of the pixel data, and outputs the quantization result to the variable length coding circuit 220.

The variable length coding circuit 220 run-length codes the quantization result input from the quantization circuit 208 and outputs the result as the sub-picture pixel data to the control portion 24 and the decoding circuit 222.

The control portion 24 is a computer comprising, for example, a microprocessor (CPU), a memory, and periphery circuits of the same and controls the operation of the constituent parts of the DVD recording apparatus 1 based on the data input from the constituent parts of the DVD recording apparatus 1.

Further, the control portion 24 buffers the sub-picture pixel data input from the variable length coding circuit 220 or records and reproduces the same by using for example the hard disc drive 240 and output this to the multiplexing portion 106 (FIG. 5) at a timing indicated by the time code of the sub-picture pixel data.

Further, the control portion 24 controls the timing etc. of the fetching of the data of the variable length coding circuit 220 and the decoding processing of the decoding circuit 222 based on the result of comparison between the range of the time code of each of the sub-pictures contained in the indication data input from the operation terminal 200 (FIG. 5) or the editing device (not illustrated) etc. and indicating the object of the encoding and the time code TC of the video data input from the time code generation circuit 202.

Further, the control portion 24 decides that there is a sub-picture within a range where there is a pixel with a value of the quantization result input from the quantization circuit 208 becoming 1 to 3 (01 to 11) as shown in FIG. 7 (decides there is a part where only pixels with a value of the quantization result becoming 0 (00) exist as there is no sub-picture) based on the result of encoding of the sub-picture encoder 2, derives the rectangular region in which the sub-picture exists, and finds the coordinate values indicating the top left and bottom right of this rectangular region ((XS, YS), (XE, YE)). Note that the coordinate values ((XS, YS), (XE, YE)) of the rectangular region found by the control portion 24 are used for the control of the superimposing processing of the background video and sub-picture by the adder circuit 224.

Further, the control portion 24 generates the sub-picture pixel data shown in FIG. 3 and the navigation commands and the menu screen data shown in FIG. 4 and outputs the same to the multiplexing portion 106 together with the sub-picture pixel data.

The decoding circuit 222 carries out the inverse processing to that of the variable length coding circuit 220 with respect to the sub-picture data input from the variable length coding circuit 220, generates the data corresponding to the result of quantization of the quantization circuit 208, and outputs the same to the adder circuit 224.

The adder circuit 224 multiplies the coefficient k (0.gtoreq.k.gtoreq.1) with the pixel data of the part of the rectangular region shown in FIG. 7 among the results of quantization input from the decoding circuit 222 according to the control of the control portion 24, multiplies a coefficient (1-k) with the background video data input from the external device (background; for example the same as the video data input to the video encoder 100 (FIG. 5)), adds these multiplied values, and outputs the same to the monitor device of the operation terminal 200. Note that the adder 224 passes the background video data other than that of the rectangular region as it is without carrying out the multiplication with the coefficient (1-K) and the addition of the quantization value multiplied by the coefficient k.

The monitor device of the operation terminal 200 displays the video data input from the adder circuit 224 to indicate this to the user of the DVD recording apparatus 1. The user can confirm the darkness of the video of the sub-picture or the timing etc. of the display of the sub-picture while viewing the video displayed on the monitor device of the operation terminal 200 and further inputs the data to the sub-picture encoder 2 via the operation terminal 200 to adjust the darkness of the video of the sub-picture (coefficient k (1-k)) and the timing etc. of display.

Menu preparation portion 3

FIG. 8 is a view of the configuration of the menu preparation portion 3 of the DVD recording apparatus 1 shown in FIG. 1.

As shown in FIG. 8, the menu preparation portion 3 adopts a configuration similar to that of the computing device of a general PC etc. It is constituted by an operation terminal 300, a microprocessor (CPU) 310, a memory (MEM) 312, a hard disc drive (HDD) 320, a floppy disc drive 322, and a sub-picture encoder 330 which are connected via a bus 332. A monitor device 332 is further connected to the sub-picture encoder 330. The operation terminal 300 is constituted by a CRT display device 302 and an input device 304 having a keyboard and mouse as shown in FIG. 5.

The menu preparation portion 3 is configured so as to enable the user to write the data comprising the menu screen without omission of required data and without having to be aware of the data structure shown in FIG. 3 by these constituent parts and, in addition, to prevent the occurrence of an error due to mistaken writing of the data by the user before occurrence. That is, the menu preparation portion 3 acts as a compiler having a very high intelligence used only for preparation (authering) of a sub-picture of the navigation command and menu screen.

The user can proceed with the work for writing the data by a dialog format (inter-actively) by a GUI (Graphical User Interface) provided by the menu preparation portion 3. The menu preparation portion 3 automatically prepares the data comprising the menu screen suited to the data structure shown in FIG. 4 by software processing by using the data inter-actively written by the user and, at the same time, carries out the superimposing of the data on the background video and displays the same to indicate it to the user.

Explanation of constituent parts of the menu preparation portion 3

In the menu preparation portion 3, the microprocessor 310 executes the program stored in the memory 312 to control the operation of the constituent parts of the menu preparation portion 3.

Further, the microprocessor 310 displays the menu preparation use image (mentioned later by referring to FIG. 9 to FIG. 13) in the menu preparation portion 302 of the operation terminal 300 to indicate the same to the user.

Further, the microprocessor 310 generates the navigation commands (N.sub.1 and N.sub.2 of FIG. 4A and N.sub.3 of FIG. 4C) comprising the menu screen shown in FIGS. 4A to 4C and the data of the menu screen (S.sub.1, S.sub.2, and S.sub.4 to S.sub.10 of FIGS. 4A to 4C) by using the operation data input by the user to the input device 304 of the operation terminal 300 by the inter-active operation in accordance with the menu preparation use image displayed in the menu preparation portion 3 and outputs the same to the hard disc drive 320 and the floppy disc drive 322.

Further, the microprocessor 310 generates the pixel data (S.sub.3 of FIG. 4B) of for example the still picture (sub-picture) shown in FIG. 3 by using the generated data of menu screen or data of the menu screen reproduced by the hard disc drive 320 or the floppy disc drive 322 and outputs the same to the sub-picture encoder 330.

The hard disc drive 320 and the floppy disc drive 322 record the navigation command, sub-picture data (FIGS. 4A to 4C), and the sub-picture pixel data (FIG. 3) generated by the microprocessor 310 under the control of the microprocessor 310, reproduces the recorded data, and output the same to the microprocessor 310.

The sub-picture encoder 330 encodes the pixel data of the sub-picture generated by the microprocessor 310 or the pixel data of the sub-picture reproduced by the hard disc drive 320 or the floppy disc drive 322 in the same way as the sub-picture encoder 2 shown in FIG. 5 and FIG. 6, outputs the same to the multiplexing portion 106 (FIG. 5), and, at the same time, carries out the processing for superimposition of the same on the background video (background) and displays this on the monitor device 332 to indicate it to the user.

Explanation of contents of GUI screen and data corresponding to operation buttons

Below, an explanation will be made of the contents of the GUI screen displayed by the microprocessor 310 of the menu preparation portion 3 and the data corresponding to tire windows and icons in the GUI screen.

The software processing by the microprocessor 310 is characterized in that the user can carry out the authering work with a high efficiency by arranging and classifying the structure of the navigation commands and menu screen data shown in FIGS. 4A to 4C again and further displaying the GUI (graphical user interface) screen on which these data are brought into one-to-one correspondence with icons without making the user feel uncomfortable at the time of authering work. In addition, navigation commands and menu screen data free from contradiction are obtained as the result of the authering work.

The data shown in FIGS. 4A to 4C and the work of the user when preparing these data are classified into three types as shown in brief in the following Table 1.

            TABLE 1
            Type of data shown in
            FIG. 4                     Work of user
       1    Program chain PGC          Work of determining type
            Link relationship          and number of menus
            among PCGs
            Post-command POST_CMD
       2    ACCESS_UNIT                Refer to sub-picture pixel
                                       data
                                       Prepare ACCESS_UNIT
       3    HLI                        Assign functions of
                                       operation buttons of menu
                                       screen