Playing audio files at high priority6354748Abstract An application programming interface (API), implemented on a general-purpose host processor, receives functions calls from an application to control the play of an audio file. The API translates the function calls into host-to-board messages and transmits the host-to-board messages to an audio task, implemented on a digital signal processor. The audio task plays the audio file based on the host-to-board messages received from the API at a higher priority than one or more other audio files. The API and audio task allow the application to select a Microsoft.RTM.-standard Wave file for play at a higher priority than other Wave files. By using the API, the application has control of the number of times the file is played back and when playing stops. The application gets notification of playback complete from the audio task via the API. Claims What is claimed is: Description BACKGROUND OF THE INVENTION
typedef struct tagChanMsgData {
WORD wMsg; // message identifier.
DWORD dwMsgParam; // message specific parameter/value.
DWORD dwSequence; // sequence number for a series of
control packets.
WORD wBufferSize; // size of the buffer following the
structure.
} ChanMsgData, FAR* LPCHANMSGDATA;
In order to send additional data along with a control channel structure, data is arranged following the structure. The size amount of data is specified, in number of bytes, by the dwBufferSize field. Four messages have been defined: mute, high quality snapshot, application launch, and application launch response. Mute Message Only wMsg and dwMsgParam are used for the MUTE message. wMsg: value=1. dwMsgParam: LOWORD of dwMsgParam specifies the audio state. 0=audio mute off 1=audio mute on 2=no change HIWORD of dwMsgParam specifies the video state. 0=video mute off 1=video mute on 2=no change For example, to mute video without changing the state of audio dwMsgParam would be MAKELONG(2, 1). CVideoController sets the mute state when the user clicks the mute button and informs the peer about its new state using the control channel. High-Quality Snapshot Message The SNAPSHOT message is sent to the peer application when a still image capture that disables outgoing video stream is in progress. For example, to achieve a certain still image quality, outgoing video may have to be disabled. In these situations, the SNAPSHOT message is sent to peer application. The message is resent when the flow of outgoing video resumes. Only wMsg and dwMsgParam are used for the SNAPSHOT message. wMsg: value=2. dwMsgParam: LOWORD of dwMsgParam specifies the snapshot state. 0=High-quality mode OFF 1=High-quality mode ON Application Launch The APPLAUNCH message is sent to a remote node to launch an application. The application path is specified in the buffer following the control channel structure. wBufSize holds the size of the buffer. The other fields are not used. wMsg: value=101. Application Launch Response The APPLAUNCHRESPONSE message is sent by the remote node that was asked to launch an application. The return code of the Microsoft.RTM. Windows.TM. WinExec function is passed back in dwMsgParam. The other fields are not used. wMsg: value=102. CChanPair CVideoController has an instance of a CControlChannel class which is derived from the class CChanPair. CChanPair provides an abstraction of CMDLL and TII services. Video View Class Relationships The CVideoView class' main responsibilities are to manage image (video) windows (ClmageWindow) and handle the control bar operations available in the video panels (CVideoViewPanel). There exist two classes, CLocalView and CRemoteView, that encapsulate specific functionality of the remote and local windows. The CLocalView and CRemoteView classes have a CLocalImage and CRemoteImage class, respectively. In addition, CLocalViewPanel and CRemoteViewPanel have been derived to contain functionality specific to the local and remote windows. CVideoView knows about the CVideoController class. When the user selects a function such as size or snapshot in the panels, the CVideoView informs the CVideoController about the user's request. CVideoController is responsible for auto-sizing the video windows. Handset Class Relationships As described earlier, the CAppFrame class has an instance of a CHandset. The CHandset class is a window. The controls inside the handset window are specified in a dialog template. This is the reason why CHandset is derived from CDialog. A modeless and borderless dialog box is placed on top of a window, in this case, CAppFrame. CHandset is responsible for handling all button clicks and user interactions in the handset area. In addition to using several MFC defined classes, CHandset also has a CLcd and a speed dial list, a CSDComboBox. The CLcd class consists of instances of CStatic for call progress information and call duration, and of CEdit for entering the number to dial. CSDComboBox is an owner-drawn listbox that displays the five most recently dialed numbers and also speed dial numbers. Finally, CHandset contains several buttons. An interface is defined for interactions between CHandset and CSpeedDial. When a number has been dialed, the CHandset informs CSpeedDial about the dialed number. CSpeedDial is then responsible for updating the speed dial list (the CSDComboBox) and the PSVIDEO.INI file. Dialog Boxes Conferencing application 502 contains several dialog boxes. The focus of this section is to describe CCyDialog. A special dialog box class is derived from CDialog to avoid problems when dialog boxes are displayed when the application is in split mode and some or all of the topmost windows (handset, local video, remote video, snapshot) are always-on-top. Specifically: (1) If a dialog is brought up when the application was in split mode (3 Windows) and one of the topmost windows is always-on-top, then portions of the dialog box would otherwise be obscured by the always-on-top window. For example, the Preferences dialog box would be on top of the handset window but underneath the remote window. (2) When the user brings up a dialog box when the applications is in split mode (3 Windows), the user would otherwise be able to click on the local window and then obscure the dialog box. The problem with (1) is that the OK and Cancel buttons would often be hidden by the video windows, so the application would be difficult to use. The problem with (2) is that a user could bring up a modal dialog box but perform functions outside of the dialog box before closing it. To make the application easier to use and more consistent with Microsoft.RTM. Windows.TM. operating system standards, CCyDialog is introduced and the problematic dialog boxes are derived from CCyDialog instead of CDialog. As a result, problems (1) and (2) are fixed. When a dialog box derived from CCyDialog is initialized, if the ProShare application has any visible topmost windows and the dialog box's owner is not topmost (e.g., the local window is topmost, but the owner of the Preferences is the handset window), then the dialog box owner window is made topmost to ensure the dialog is visible. To prevent the user from clicking in other application windows, all other topmost windows are disabled. These operations are reversed when the dialog box is destroyed. When the user switches between conferencing application 502 and other applications, special care is taken due to the modifications made in CCyDialog::OnInitDialog. When conferencing application 502 is deactivated, CCyDialog::OnActivateApp turns temporary topmost off, and then back on when the application is re-activated. In addition, CCyDialog::OnActivateApp reenables the user interface while conferencing application 502 is deactivated so the user can click on any of the conferencing application's visible windows to get back to the dialog (and re-activate conferencing application 502). Helper Classes Dialog Helper The dialog helper class, CDialogHelper, provides a method for obtaining dialog boxes with exact pixel dimensions in the Microsoft.RTM. Windows.TM. environment. The Microsoft.RTM. Windows.TM. M operating system provides support for dialog boxes, both in the API and in the support tools (dialog editors), but the coordinates used for dialog boxes and their elements are not pixels but "dialog units," which are calculated according to the font and display driver in use. Dialog boxes are not created with exact pixel dimensions and coordinates using this support, yet this is often desired, for example, when the position of dialog elements relates to a fixed size live video display (160.times.120 pixels). The CDialogHelper class simplifies the manipulation of dialog boxes. If a dialog box is designed with the assumption that 1 dialog unit=1 pixel, CDialogHelper can use a dialog template to resize and position dynamically the dialog elements correctly. The procedure follows: Create the dialog box initially invisible. Load the dialog template used to create the dialog box. For each control referenced in the template, Get a handle to the actual control, and Use the coordinates from the template to reposition and resize the control. Use the coordinates from the template to resize the entire dialog box. Unload the dialog template. Make the dialog box visible. By using a dialog template that is a subset of the template used to create the dialog box, it is possible to resize and reposition only some of the controls, enabling a combination of pixel and dialog units to be employed. Fast Bitmaip Buttons An owner-draw button class, CFastBmpBtn, solves the following problems: (1) Microsoft.RTM. Windows.TM. operating system provides basic button objects in several styles (particularly push buttons, check boxes, and radio buttons) with a default graphical appearance that is not easily customized. It is possible for an application to use "owner-draw" buttons, but then all distinction between button types is lost and the application must implement check box and radio button functionality itself. The Microsoft.RTM. Foundation Classes (MFC) provide a bitmapped button class that allows an application to provide up to four images to represent the various states of a button (up, depressed, with focus, and disabled), but this does not solve the basic problem, and each image must be stored in a separate bitmap, making maintenance difficult. (2) When a user clicks on a Microsoft.RTM. Windows.TM. button with the mouse cursor, the button takes the input focus even if the user moves the cursor off the button before releasing the mouse button, thereby not generating a button press event. This makes it difficult for an application to keep the input focus in a desired location (e.g., an edit control). The two problems above are solved in the following manner: (1) CFastBmpBtn, a C++ class derived from the basic MFC window class, allows the developer to start with generic buttons, specifying the styles as desired, then add only three lines of code and one bitmap per button to obtain a flexible graphical appearance. The class dynamically subclasses the existing button object, taking over all standard button actions, in particular the drawing of the button. The bitmap contains 4, 8 or 12 images arranged vertically in a strict order, each representing a different button state (up, depressed, with focus, and disabled) for each of the possible check states unchecked, checked, and indeterminate check. The appropriate image is used to draw the button in response to system requests and in direct response to user interaction with the mouse. The CFastBmpBtn sends notification messages to the parent window in the same manner as standard buttons. (2) The CFastBmpBtn::SetButtonFlags function allows an application to set the CFastBmpBtn::RestoreFocus flag for a particular button. When this flag is set, the button will remember which window previously had focus whenever it receives focus due to a mouse click, and will restore the focus to the window when the mouse button is released. CFastBmpBtn is used to implement the graphical buttons in user interfaces for conferencing system 100. An example is the handset and control panel buttons in the conferencing application 502. Data Conferencing Application Data conferencing application 504 implements the data conferencing user interface. Data conferencing application is implemented as a Microsoft.RTM. Windows.TM. 3.1 application. The data conferencing application uses a "shared notebook" metaphor. The shared notebook lets the user copy a file from the computer into the notebook and review it with a remote user during a call. When the user is sharing the notebook (this time is called a "meeting"), the users see the same information on their computers, users can review it together, and make notes directly into the notebook. A copy of the original file is placed in the notebook, so the original remains unchanged. The notes users make during the meeting are saved with the copy in a meeting file. The shared notebook looks like a notebook or stack of paper. Conference participants have access to the same pages. Either participant can create a new page and fill it with information or make notes on an existing page. A preferred embodiment of a data conferencing application is described in U.S. patent application Ser. No. 08/137,319 (filed Oct. 14, 1993) and in U.S. patent application Ser. No. 08/170,146 (filed Dec. 20, 1993). Conference Manager Referring again to FIG. 5, audio/video conferencing application 502 supports audio and video conferencing between remote locations, while data conferencing application 504 supports the sharing of data (e.g., documents) between the remote locations. In general, conferencing system 100 is capable of simultaneously supporting multiple applications that support different types of conferencing services (e.g., audio/video conferencing, data sharing, and background file transfer). When a single telephone line is used as the transport medium, the conference applications may need to share that line. Conference manager 544 (also known as CMDLL) coordinates connection and data channel activities for the conference applications. It provides capabilities to centralize and coordinate dial, hang-up, data channel management activities, and application launching. It enables conference applications to establish and tear down connections. It also provides applications access to already established connections. A connection is established through the conference manager 544 instead of calling the communication software (i.e., comm manager 518 via comm API 510) directly. Data channels are also obtained through the conference manager 544. Conference manager 544 and conferencing API 506 provide the following advantages to conferencing system 100: It is application aware (i.e., if application A on conferencing system X attempts to establish a data channel with application A on conferencing system Y, the conference manager 544 will automatically launch application A on system Y if application A is not already running). It simplifies the establishment of a full duplex channel by providing a single simplified call to establish such a channel. It allows applications that would normally use a single dedicated connection to share a connection. It provides an efficient mechanism to inform applications about events such as "connection established" and "connection torn down." It adds a layer of control for channel management (e.g., when an application with open channels terminates, the open channels are guaranteed to become closed). The main purpose of conference manager 544 is to provide a set of services that allows several conference applications to share a common connection. The model is that once a connection is established by some application, any conference application can latch on to the connection and establish a full-duplex communication channel with its peer application running on the remote machine. The full duplex channel is implemented as a channel pair, or in TII terms, one outgoing and one incoming channel. The conference manager services are used in conferencing system 100 to coordinate connection and data channel activities for the audio/video and data conferencing applications. The conference manager software sits between the applications (clients) and the communication software. A connection is established through the conference manager 544 instead of calling the communication software directly. Data channels are also obtained through the conference manager 544. Conference manager 544 also implements an application registry which gives it some intelligence as to which conference applications are running. This approach has several advantages; (1) Conference manager 544 is application aware. This means that if application A on computer X attempts to establish a data channel with application A on computer Y, conference manager 544 will automatically launch A on system Y if it is not already running. (2) It simplifies the establishment of a full duplex channel. It provides a single simplified call to establish such a channel. (3) It allows applications that would normally use a single dedicated connection to share a connection. (4) It provides a nice mechanism to inform applications about events such as "connection established" and "connection torn down." (5) It adds a layer of control for channel management. For example, when an application with open channels terminates, its channels are guaranteed to get closed. Conference Manager Overview Conference manager 544 consists of several modules. The most important ones are as follows:
cmcall.c Contains the icmMakeCall and icmHangupCall procedures that are
called from
the CMIF library.
cmchan.c Contains the implementation of channel related procedures
specified in the
conference manager API. These are cmGetChannelPair,
cmCloseChannelPair,
and cmGetChannelPairInfo.
cmclntfy.c Contains dialog box procedures for the dialogs that are
displayed on incoming
calls. There is one dialog for the case when the caller ID
matches a record in
the address book, and one dialog for the case when a match is not
found.
cmdll.c Contains the LibMain and WEP procedures. Also contains various
initialization procedures, including Lib_InitializeCf which loads
VCI.DLL and
makes the VCI call CF_Init to initialize the comm subsystem and
Lib_TerminateCf which calls CF_UnInit and unloads VCI.DLL. This
module
also contains code for registering and unregistering with the
address book
services provided by ABDLL.DLL.
cmmisc.c Contains miscellaneous supporting functions used throughout the
other
modules in CMDLL.
cmnotify.c Contains callbacks required by VCI. The callback
Lib_CfCallCallBack
handles the CFM_* messages such as CFM_CALL_NTFY and
CFM_CALL_HANGUP. The callback Lib_CfChanCallBack handles VCI
CFM_CHAN_* channel messages such as CFM_CHAN_ACCEPT_NTFY and
CFM_CHAN_REJECT_NTFY.
cmreg.c Contains the implementation of the conference manager API
functions
cmRegister, cmUnregister, and cmInstall.
Implementation Details This section describes the implementation details of key areas of CMDLL 544. Conference Application Installation In order to make CMDLL 544 aware of conference applications, conference applications are preferably installed. Installed applications are listed in the [Conference Apps] section in the PSVIDEO.INI file. Applications are typically installed directly by an installation program. It is also possible for an application to install itself by calling cmInstall (if, for example, the PSVIDEO.INI file has been corrupted subsequent to installation). Conference Application Registration Before a conference application makes use of CMDLL services, it is loaded and registered with the DLL. An application registers with CMDLL 544 by calling cmRegister. This function is in the module cmreg.c. CMDLL 544 keeps track of registered applications, and for each registered application, a CONFAPP structure is filled in. CMDLL 544 has a dynamically allocated array of CONFAPP structures. This array is built based on the applications that are installed (i.e., specified in the [Conference Apps] sections in the PSVIDEO.INI file). If an application attempts to register without being installed cmRegister will fail. After an application has registered with CMDLL 544, subsequent calls by said application do not require the application ID to be specified. CMDLL 544 keys off of the application's task handle and is able to map a task to an application ID. Registered applications are notified through a callback about certain events such as connection establishment and connection tear-down. VCI Call Handler Callback CMDLL 544 is responsible for handling VCI 506 call callback messages. Most messages are generated by the comm subsystem as a result of calls to VCI 506. All calls in VCI 506 are asynchronous, hence the messages in this callback. This callback, Lib_CfCallCallBack, is located in the module cmnotify.c and a pointer to the function is provided to VCI.DLL in the call CF_Init. The Lib_CfCallCallBack callback is defined as follows: BOOL CALLBACK Lib_CfCallCallBack( IN UINT uiMsg, IN WPARAM wParam, IN LPARAM lParam ) Channel Pair Establishment CMDLL 544 provides a high-level service, cmGetChannelPair, that enables conference applications to establish easily a channel pair, i.e., one channel for inbound data and one channel for outbound data. The cmGetChannelPair uses VCI services (which in turn use TIl services). Applications may establish up to 32 channel pairs. Each channel pair has an associated usage ID which is defined by the application. In this way, when an application establishes a channel pair, its peer (or peers in a multipoint environment) will know the purpose of channel pair. For example, one channel pair could be established for file transfer and another channel pair for control data. Appropriate channel handlers (e.g., TII/VCI) can thus be specified for different channels. As noted earlier, CMDLL 544 keeps track of each application with an array of CONFAPP structures. A CONFAPP structure contains an array of structures of the type CHANNELPAIR, which is defined as follows:
typedef struct tagCHANNELPAIR
{
HCHAN hChanIn; // input (receive) channel
HCHAN hChanOut; // output (send) channel
WORD wState; // channel pair state (CPS_*)
CMCHAN_INFO cmChanInfo; // channel info struct
} CHANNELPAIR;
In turn, each channel pair contains a CMCHAN_INFO structure, which is
defined as follows:
typedef struct tagCMCHAN_INFO
{
HCHAN hChanIn; // input (read) channel
HCHAN hChanOut; // output (send) channel
CHAN_INFO chanInfo; // channel information
DWORD dwTransId; // transaction id
BYTE byUsageId; // usage id
BOOL bOpener; // TRUE if initiator of
cmGetChannelPair, else FALSE
} CMCHAN_INFO;
This structure, in turn, contains the CHAN_INFO structure defined by TII 510. When a channel pair is established, certain information is transferred between the peer CMDLLs. This information is transferred in the CHAN_INFO structure. Successful channel pair establishment happens as follows. First a connection is established. The application on Site A calls cmGetChannelPair. CMDLL then handles all the VCI details of establishing outbound and inbound data channels using the CF_OpenChannel and CF_AcceptChannel VCI calls. Once the two channels have been established at the CMDLL level, CMDLL calls the applications back with the channel handles. Once the application receives the channel handles through the CMN_CHANNELPAIR message, the application registers a channel handler using the VCI call CF_RegisterChanHandler. The cmGetChannelPair procedure fills in the Id field of the CHAN_INFO structure and then calls CF_OpenChannel. The rest of the processing for setting up the channel pairs takes place in the channel manager callback Lib_CfChanCallBack. The Id field is important in that it identifies: Which application is establishing a channel pair (which is important for CMDLL on the remote site so that it knows which application to notify). The usage id for the channel pair (which is important for the remote application so that it knows what to do with the channel pair). Whether the channel that is being opened is inbound or outbound. Critical Sections One of the key elements of CMDLL 544 is that it notifies conference applications of several events that take place in the comm subsystem, e.g., an incoming call. CMDLL 544 is also responsible for calling the comm subsystem in response to user-initiated events, e.g., hang up a call. CMDLL 544 is also responsible for starting and stopping playback of audio feedback through the PWave interface. CMDLL 544 may be interrupted by the comm subsystem while it is in the process of handling events initiated by the user. For example, while CMDLL 544 is in icmHangupCall processing, it may be interrupted by a CFM_REJECT_NTFY notification message from the comm subsystem. The critical section code prevents re-entrancy problems. It prevents the application from having to deal with call rejection messages when in fact it is already in the process of hanging up. Three global variables are declared in cmmisc.c for the purpose of critical sections: UINT G_nProgressCriticalSection=0; UINT G_nHangupCriticalSection=0; UINT G_nRejectCriticalSection=0; These variables are manipulated and examined in cmcall.c in icmHangupCall and in the handling of the CFM_REJECT_NTFY and CFM_PROGRESS_NTFY messages in the VCI call callback routine Lib.sub.13 CfCallCallBack in cmnotify.c. Call Notification and Caller ID CMDLL 544 is responsible for listening for incoming calls, notifying the user of incoming calls, and for rejecting or accepting the incoming call as specified by the user. On incoming calls, VCI 506 calls the Lib_CfCallCallBack with the CFM_CALL_NTFY message. As outlined in the VCI Call Handler Callback section, if caller ID is available (through the lParam of the callback message), then the callback function performs a series of address book queries to determine the name and additional information of the caller. Once the series of address book queries have been completed, the procedure CallNotifyDlg_Do is called. It is responsible for calling one of two dialog box procedures: one if caller ID is unavailable from the comm subsystem or if the address book query failed, and a different dialog box if the address book query produced a match. This procedure is also responsible for disabling all top-level windows (handset, remote, local, and snapshot). This is done to prevent the user from accessing other features when an incoming call is pending. Accessing other features when a call is pending causes re-entrancy problems.
BOOL CallNotifyDlg_Do(
IN HWND hWndOwner, // owner of dialog windows (handset
window)
IN HAB_REC hAbRec, // address book record, possibly NULL
IN LPSTR lpszCallerID // caller ID string from comm subsystem
)
Audible Call Progress CMDLL 544 is responsible for providing audible call progress. CMDLL 544 uses the PWave services for starting and stopping playback of wave files. PWave can play a sound both synchronously and asynchronously. In the synchronous case, the number of times to play a file is specified, and the StartWavePlayback procedure does not return until it is finished playing the file the specified number of times. In the asynchronous case, the StartWavePlayback procedure returns immediately. In this case, PWave allows CMDLL to stop wave file playback at any time. Audible call progress is provided in the following situations: Incoming call: The RINGIN.WAV wave file starts playing asynchronously in the WM_INITDIALOG case in the call notification dialog boxes. Playback ends when the user accepts the call, rejects the call, or the caller hangs up. Incoming call in auto answer mode: The AABEEP.WAV file is played once when a call comes in and the application is in auto-answer mode. Outgoing call: The RINGOUT.WAV file is played on the callers machine. This wave file is played to the caller to inform that the callee's machine is ringing. The RINGOUT.WAV file starts playing asynchronously when the comm subsystem calls the callback Lib_CfCallCallBack with the CFM_PROGRESS_NTFY message (with LOWORD(lParam) equal to CF_CALL_RINGING). Playback stops if the caller hangs up, or the callee accepts or rejects the call. Busy signal: The BUSY.WAV file is played once on the caller's machine if the callee is already in a video conference. Error signal: The PROBLEM.WAV file is played once in response to the CFM_REJECT_NTFY message in the callback Lib_CfCallCallBack. The RINGIN.WAV file is the default wave file for incoming call notification. The user may optionally select a different wave file. This is done with a video preferences dialog box. If a different wave file has been selected, the PSVIDEO.INI file will contain the following entries: [Preferences]
AudioPreference=1 ; 0 means use default
Wavepath=c:.backslash.myring.wav ; if AudioPreference is 1, use this wave
file
for incoming calls
The selected wave file meets the following criteria: sampled at 8 kHz, 8 bits, mono, and it is no larger than 64 K. On Demand Annlication Invocation Conventional electronic conferencing applications require that both sites be running versions of the conferencing application prior to initiating the sharing of information (i.e., conferencing). As a result, users must confirm (e.g., via an independent telephone call) that the appropriate applications are running before sharing information. In a conferencing network comprising preferred embodiments of conferencing system 100, only one site need be running a conferencing application before information sharing can be initiated. Moreover, if possible, the same application on the remote site is launched to complete the sharing. Conference manager 544 of FIG. 5 provides these capabilities. Conference manager 544 allows an application to install, registerlunregister, make/hang-up calls, and establish/destroy communication channels. After successfully placing a call to a remote site, a conferencing application may try to establish a communication channel. In the process of establishing communication channels, the application is capable of being launched remotely if it is necessary. To accomplish this, all conferencing applications are assigned a unique application ID (i.e., APPID). When an attempt to establish a communication channel is made, the application ID is used to identify the application for that channel. The conference manager 544 uses the APPID to determine (a) if the application is installed and (b) if the application is currently running. If the answer is yes to both of these questions, then the communication channel can be established immediately. If the answer is yes to (a) and no to (b), then the conference manager 544 is able to launch the desired application (via the Microsoft.RTM. WinExec function) and poll for registration. If the answer is no to both (a) and (b), then the communication channel will fail to be created. Referring now to FIG. 33, there is shown a flow diagram of the on-demand application invocation processing of conferencing system 100 of FIG. 5, according to a preferred embodiment of the present invention. On-demand application invocation applies when a conferencing application (App #1) running in one conferencing system (Site A) attempts to establish a conference with another conferencing system (Site B), where App #1 is installed but not currently running in Site B. App #1 in Site A starts the process by causing a request for a comm channel to be sent to Site B to establish communication between Site A and Site B. The comm channel request identifies the application running in Site A (e.g., APPID for App #1). As shown in FIG. 33, the conference manager 544 of Site B receives the comm channel request from Site A (step 3302). The conference manager 544 of Site B retrieves the application ID for App #1 from the comm channel request and determines whether App #1 is installed in Site B (step 3304). If App #1 is not installed in Site B (step 3306), then the requested conference cannot proceed and the conference manager 544 of Site B causes the comm channel request of Site A to be rejected (step 3308). Otherwise, if App #1 is installed in Site B (step 3306), then the conference manager 544 of Site B determines whether App #1 is registered, indicating that App #1 is already running in Site B. If App #1 is registered (step 3310), then processing continues to step 3318 as described below. Otherwise, if App #1 is not registered (step 3310), then the conference manager 544 of Site B attempts to synchronously launch App #1 (by calling the WinExec function of the Microsoft.RTM. Windows.TM. operating system) and thereby inform App #1 of Site B that a call is in progress (step 3312). After attempting to launch App #1, the conference manager 544 of Site B checks to see whether App #1 was successfully launched by determining whether App #1 is now registered. If App #1 is still not registered (step 3314), then something went wrong in launching App #1 in Site B and again the conference manager 544 of Site B causes the comm channel request of Site A to be rejected (step 3316). Otherwise, if App #1 is now registered (step 3314), then the conference manager 544 of Site B accepts the comm channel request from Site A (step 3318) and notifies App #1 of Site B that the comm channel is open (step 3320) allowing conferencing to proceed. The pseudocode for the local site communication channel establishment (Site A) is as follows: request a communication channel get notified when it has been established (or failed) The pseudocode for the remote site communication channel establishment (Site B) is as follows: get a communication channel request get the appid from the request if the application is not installed then reject the communication channel request elseif the application is not registered then Wined the application inform the application there is a call in progress if the application is still not registered then reject the communication channel request accept the communication channel request notify application that comm channel is open Through this on-demand invocation of applications, one conferencing system running a conferencing application can cause a remote conferencing system to invoke a corresponding application at the remote site. Those skilled in the art will understand that this capability alleviates the requirement for arranging for a conference by external means (e.g., via telephone) to coordinate the parallel independent launching of the corresponding conferencing applications in the remote sites. Managing Multiple Applications Comm API (i.e., transport independent interface (TII)) 510 of FIG. 5 establishes connections with remote conferencing systems for conferencing sessions. TII 510 also establishes one or more channels within each connection for use by conferencing applications (such as 502 and 504). These channels are used by the applications for transmitting or receiving different types of information with the remote conferencing systems. For example, audio/video conferencing application 502 uses four channels to transmit and receive audio and video signals to and from a remote conferencing system. Similarly, data conferencing application 504 uses two channels to transmit and receive data signals to and from a remote conferencing system. The conference manager 544 of FIG. 5 provides the capability for two or more conferencing applications to share a single connection in a single conferencing session with a remote conferencing system. This capability allows two or more conferencing applications to participate in the same conferencing session simultaneously using a single connection between the local and remote conferencing systems. Referring now to FIG. 34, there is shown a flow diagram of an example of the processing implemented within conferencing system 100 of FIG. 5 to manage two conferencing applications in a single conferencing session with a remote conferencing system, according to a preferred embodiment of the present invention. The processing of FIG. 34 begins with the audio/video conferencing application 502 by asking the conference manager 544 to establish a connection for conferencing with a remote conferencing system (step 3402). Application 502 makes this request by calling the cmMakeCall function of the conference manager 544. The conference manager 544 passes the connection request to the conferencing API (VCI) 506 by calling the CF_MakeCall( ) function (step 3404). VCI 506 in turn passes the connection request to TII 510 by calling the MakeConnection function (step 3406). TII 510 causes the connection with the remote conferencing system to be established and also establishes four channels (i.e., transmit/receive audio/video) within that connection for the audio/video conferencing application 502 to use (step 3408). As part of this step, VCI 506 causes handles for the four channels to be passed back to application 502. TII 510 causes the connection and channels to be established by communicating with the peer TII 510 of the remote conferencing system. Data conferencing application 504 then asks the conference manager 544 to establish channels within the established connection for transmitting and receiving data signals with the remote conferencing system (step 3410). Data conferencing application 504 knows that the connection has been established, because application 504 has already registered with the conference manager 544 and the conference manager 544 informs all registered applications of connections by sending the CMN_CALL message. Since data conferencing application 504 already knows that the connection has been established, application 504 makes the channel request by calling the cmGetChannelPair function of the conference manager 544. The conference manager 544 then passes the channel request to the VCI 506 (by calling CF_OpenChannel) (step 3412). VCI 506 in turn passes the channel request to TII 510 (by calling OpenChannel) (step 3414). Conference manager 544 establishes the two requested channels for data conferencing application 504 within the already established connection with the remote conferencing system (step 3416). As part of this step, conference manager 544 causes handles for the two channels to be passed back to application 504. The conferencing session is then able to proceed with both applications 502 and 504 using a single. connection with the remote conferencing system for its different channels (step 3418). Conferencing API Conferencing API 506 of FIG. 5 (also known as video conferencing interface (VCI)) facilitates the easy implementation of conferencing applications 502 and 504. Conferencing API 506 of FIG. 5 provides a generic conferencing interface between conferencing applications 502 and 504 and the video, comm, and audio subsystems. Conferencing API 506 provides a high-level abstraction of the services that individual subsystems (i.e., video, audio, and comm) support. The major services include: Making, accepting, and hanging-up calls. Mediating conference requirements between peers. Establishing and terminating multiple communication channels for individual subsystems. Instantiating and controlling local video and audio. Sending video and audio to a remote site through the network. Receiving, displaying, and controlling the remote video and audio streams. Conferencing applications 502 and 504 can access these services through the high-level conferencing API 506 without worrying about the complexities of low-level interfaces supported in the individual subsystems. In addition, conferencing API 506 facilitates the integration of individual software components. It minimizes the interactions between conferencing applications 502 and 504 and the video, audio, and comm subsystems. This allows the individual software components to be developed and tested independent of each other. Conferencing API 506 serves as an integration point that glues different software components together. Conferencing API 506 facilitates the portability of audio/video conferencing application 502. Conferencing API 506 is implemented as a Microsoft.RTM. Windows.TM. Dynamic Link Library (DLL). Conferencing API 506 translates the function calls from conferencing application 502 to the more complicated calls to the individual subsystems (i.e., video, audio, and comm). The subsystem call layers (i.e., video API 508, comm API 510, and audio API 512) are also implemented in DLLs. As a result, the programming of conferencing API 506 is simplified in that conferencing API 506 does not need to implement more complicated schemes, such as dynamic data exchange (DDE), to interface with other application threads that implement the services for individual subsystems. For example, the video subsystem will use window threads to transmit/receive streams of video to/from the network. Conferencing API 506 is the central control point for supporting communication channel management (i.e., establishing, terminating channels) for video and audio subsystems. Audio/video conferencing application 502 is responsible for supporting communication channel management for the data conferencing streams. Referring now to FIG. 7, there is shown a block diagram of conference manager 544 and conferencing API 506 between conferencing applications 502 and 504, on one side, and comm API 508, video API 510, and audio API 512, on the other side, according to a preferred embodiment of the present invention. Conferencing API 506 comprises conferencing finite state machine (FSM) 702, conferencing primitive validator 704, conferencing primitive dispatcher 708, conferencing callback 706, comm primitive 712, comm callback 710, video primitive 716, and audio primitive 720 of FIG. 7. Conferencing primitive validator 704 validates the syntax (e.g., checks the conferencing call state, channel state, and the stream state with the conferencing finite state machine (FSM) 702 table and verifies the correctness of individual parameters) of each API call. If an error is detected, primitive validator 704 terminates the call and returns the error to the application immediately. Otherwise, primitive validator 704 calls conferencing primitive dispatcher 708, which determines which subsystem primitives to invoke next. Conferencing primitive dispatcher 708 dispatches and executes the next conferencing API primitive to start or continue to carry out the service requested by the application. Primitive dispatcher 708 may be invoked either directly from primitive validator 704 (i.e., to start the first of a set of conferencing API primitives) or from conferencing callback 706 to continue the unfinished processing (for asynchronous API calls). After collecting and analyzing the completion status from each subsystem, primitive dispatcher 708 either (1) returns the concluded message back to the conferencing application by returning a message or invoking the application-provided callback routine or (2) continues to invoke another primitive to continue the unfinished processing. There are a set of primitives (i.e., comm primitives 712, video primitives 716, and audio primitives 720) implemented for each API call. Some primitives are designed to be invoked from a callback routine to carry out the asynchronous services. The subsystem callback routine (i.e., comm callback 710) returns the completion status of an asynchronous call to the comm subsystem to conferencing callback 706, which will conduct analysis to determine the proper action to take next. The comm callback 710 is implemented as a separate thread of execution (vthread.exe) that receives the callback Microsoft.RTM. Windows.TM. messages from the comm manager and then calls VCI DLL to handle these messages. Conferencing callback 706 returns the completion status of an asynchronous call to the application. Conferencing callback 706 checks the current message/event type, analyzes the type against the current conferencing API state and the next primitive being scheduled to determine the actions to take (e.g., invoke another primitive or return the message to the application). If the processing is not complete yet, conferencing callback 706 selects another primitive to continue the rest of the processing. Otherwise, conferencing callback 706 returns the completion status to the application. The conferencing callback 706 is used only for comm related conferencing API functions; all other conferencing API functions are synchronous. The major services supported by conferencing API 506 are categorized as follows: Initialization and Call Services (establish/terminate a conference call). Stream Services (capture, play, record, link, control the multimedia audio and video streams, and access and manipulate data from the streams). Channel Services (establish/terminate channels on the call, and send/receive data on the channels). Interfacing with the Comm Subsystem Conferencing API 506 supports the following comm services with the comm subsystem: Comm initialization--initialize a session in the comm subsystem on which the call will be made. Call establishment--place a call to start a conference. Channel establishment--establish two comm channels for video conferencing control information, two comm channels for audio (incoming/outgoing), four comm channels for video (incoming data and control and outgoing data and control). Call termination--hang up a call and close all active channels. Comm Initialization/Uninitialization Initialization of a session in the comm subsystem on which a call may be made by the user of conferencing system A of FIG. 1 and the user of conferencing system B of FIG. 1 is implemented as follows: Conferencing APIs A and B call BeginSession to initialize their comm subsystems. Conferencing APIs A and B enter a PeekMessage loop waiting for a SESS_BEGIN callback from the comm subsystem. Uninitialization of a session in the comm subsystem is implemented as follows: Conferencing APIs A and B call EndSession to uninitialize their comm subsystems. Conferencing APIs A and B receive a SESS_CLOSED callback from the comm subsystem. Conferencing APIs A and B then notify the conferencing applications with a CFM_UNINIT_NTFY callback. Call Establishment Establishment of a call between the user of conferencing system A of FIG. 1 and the user of conferencing system B of FIG. 1 is implemented as follows: Conferencing API A calls MakeConnection to dial conferencing API B's number. Conferencing API B receives a CON_REQUESTED callback from the comm subsystem. Conferencing API B sends the call notification to the graphic user interface (GUI) with a CFM_CALL_NTFY callback; and if user B accepts the call via the GUI, conferencing API B proceeds with the following steps. Conferencing API B calls AcceptConnection to accept the incoming call from conferencing API A. Conferencing APIs A and B receive CONN_ACCEPTED callback from the comm subsystem. Conferencing API A calls OpenChannel to open its outgoing conferencing control channel. Conferencing API B receives the CHAN_REQUESTED callback for the incoming control channel and accepts it via AcceptChannel. Then Conferencing API B calls OpenChannel to open its outgoing conferencing control channel. Conferencing API A receives the CHAN_ACCEPTED callback for its outgoing control channel and calls RegisterChanHandler to receive channel callbacks from the comm subsystem. Then Conferencing API A receives the CHAN_REQUESTED callback for the incoming control channel and accepts it via AcceptChannel. Conferencing API B receives the CHAN_ACCEPTED callback for its outgoing control channel and calls RegisterChanHandler to receive channel callbacks from the comm subsystem. Conferencing API A sends a Login Request on the control channel, which Conferencing API B receives. Conferencing API B sends a Login Response on the control channel, which Conferencing API A receives. Conferencing API A sends a Capabilities Request on the control channel, specifying conference requirements, which Conferencing API B receives. Conferencing API B sends a Capabilities Response on the control channel, accepting or modifying conference requirements, which Conferencing API A receives. Conferencing API A calls OpenChannel to open its outgoing audio channel. Conferencing API B receives the CHAN_REQUESTED callback for the incoming audio channel and accepts it via AcceptChannel. Conferencing API A receives the CHAN_ACCEPTED callback for the outgoing audio channel. The last three steps are repeated for the video data channel and the video control channel. Conferencing API B then turns around and repeats the above 4 steps (i.e., opens its outbound channels for audio/video data/video control). Conferencing API A sends Participant Information on the control channel, which Conferencing API B receives. Conferencing API B sends Participant Information on the control channel, which Conferencing API A receives. Conferencing APIs A and B then notify the conferencing applications with a CFM_ACCEPT_NTFY callback. Channel Establishment Video and audio channel establishment is implicitly done as part of call establishment, as described above, and need not be repeated here. For establishing other channels such as data conferencing, the conferencing API passes through the request to the comm manager, and sends the comm manager's callback to the user's channel manager. Call Termination Termination of a call between users A and B is implemented as follows (assuming user A hangs up): Conferencing API A unlinks local/remote video/audio streams from the network. Conferencing API A then calls the comm manager's CloseConnection. The comm manager implicitly closes all channels, and sends Chan_Closed callbacks to conferencing API A. Conferencing API A closes its remote audio/video streams on receipt of the Chan_Closed callback for its inbound audio/video channe ls, respectively. Conferencing API A then receive s the CONN_CLOSE_RESP from the comm manager after the call is cleaned up completely. Conferencing API A notifies its application via a CFM_HANG_NTFY. In the meantime, the comm manager on B would have received the hangup notification, and would have closed its end of all the channels, and notified conferencing API B via Chan_Closed. Conferencing API B closes its remote audio/video streams on receipt of the Chan_Closed callback for its inbound audio/video channels, respectively. Conferencing API B unlinks its local audio/video streams from the network on receipt of the Chan_Closed callback for its outbound audio/video channels, respectively. Conferencing API B then receives a CONN_CLOSED notification from its comm manager. Conferencing API B notifies its application via CFM_HANGUP_NTFY. Interfacing with the Audio and Video Subsystems Conferencing API 506 supports the following services with the audio and video subsystems: Capture/monitor/transmit local video streams. Capture/transmit local audio streams. Receive/play remote streams. Control local/remote streams. Snap an image from local video stream. Since the video and audio streams are closely synchronized, the audio and video subsystem services are described together. Capture/Monitor/Transmit Local Streams The local video and audio streams are captured and monitored as follows: Call AOpen to open the local audio stream. Call VOpen to open the local video stream. Call ACapture to capture the local audio stream from the local hardware. Call VCapture to capture the local video stream from the local hardware. Call VMonitor to monitor the local video stream. The local video and audio streams are begun to be sent out to the remote site as follows: Call ALinkOut to connect the local audio stream to an output network channel. Call VLinkOut to connect the local video stream to an output network channel. The monitoring of the local video stream locally is stopped as follows: Call VMonitor(off) to stop monitoring the local video stream. Receive/Play Remote Streams Remote streams are received from the network and played as follows: Call AOpen to open the local audio stream. Call VOpen to open the local video stream. Call ALinkIn to connect the local audio stream to an input network channel. Call VLinkIn to connect the local video stream to an input network channel. Call APlay to play the received remote audio stream. Call VPlay to play the received remote video stream. Control Local/Remote Streams The local video and audio streams are paused as follows: Call VLinkout(off) to stop sending local video on the network. Call AMute to stop sending local audio on the network. The remote video and audio streams are paused as follows: If CF_PlayStream(off) is called, conferencing API calls APlay(off) and VPlay(off). The local/remote video/audio streams are controlled as follows: Call ACntl to c ontrol the gains of a local audio stream or the volume of the remote audio stream. Call VCntl to control such parameters as the brightness, tint contrast, color of a local or remote video stream. Snap an Image from Local Video Streams A snapshot of the local video stream is taken and returned as an image to the application as follows: Call VGrabframe to grab the most current image from the local video stream. Conferencing API 506 supports the following function calls by conferencing applications 502 and 504 to the video, comm, and audio subsystems:
CF_Init Reads in the conferencing configuration parameters
from an initialization file;
loads and initializes the software of the comm,
video, and audio subsystems by
allocating and building internal data structures;
allows the application to
choose between the message and the callback routines
to return the event
notifications from the remote site.
CF_MakeCall Makes a call to the remote site to establish a
connection for conferencing. The
call is performed asynchronously.
CF_AcceptCall Accepts call initiated from the remote site based on
information received in the
CFM_CALL_NTFY message as delivered to the graphical
user interface.
CF_RejectCall Rejects incoming call, if appropriate, upon
receiving a CFM_CALL_NTFY
message as delivered to the GUI.
CF_HangupCall Hangs up a call that was previously established;
releases all resources,
including all types of streams and data structures,
allocated during the call.
CF_GetCallInfo Returns the information about the specified call,
including its current state.
CF_CapMon Starts the capture of analog video signals from the
local camera and displays
the video in the local video window which is
pre-opened by the application.
This function allows the user to preview his/her
appearance before sending the
signals out to the remote site.
CF_PlayRcvd Starts the reception and display of remote video
signals in the remote video
window, which is pre-opened by the application;
starts the reception and play
of remote audio signals through the local speaker.
CF_DestroyStream Destroys the specified stream group that was created
by CF_CapMon or
CF_PlayRcvd. As part of the destroy process, all
operations (e.g.,
sending/playing) being performed on the stream group
will be stopped and all
allocated system resources will be freed.
CF_Mute Uses AMute to turn on/off the mute function being
performed on the audio
stream of a specified stream group. This function
will temporarily stop or
restart the related operations, including playing
and sending, being performed
on this stream group. This function may be used to
hold temporarily one
audio stream and provide more bandwidth for other
streams to use.
CF_SnapStream Takes a snapshot of the video stream of the
specified stream group and returns
a still image (reference) frame to the application
buffers indicated by the
hBuffer handle.
CF_ControlStream Controls the capture or playback functions of the
local or remote video and
audio stream groups.
CF_SendStream Uses ALinkOut to pause/unpause audio.
CF_GetStreamInfo Returns the current state and the audio video
control block (AVCB) data
structure, preallocated by the application, of the
specified stream groups;
CF_PlayStream Stops/starts the playback of the remote audio/video
streams by calling
APlay/VPlay.
CF_GetAudVidStream Returns the audio and video stream handles for the
specified stream group.
CF_RegisterChanMgr Registers a callback or an application window whose
message processing
function will handle notifications generated by
network channel initialization
operations. This function is invoked before any
CF_OpenChannel calls are
made.
CF_OpenChannel Requests to open a network channel with the peer
application. The result of
the action is given to the application by invoking
the callback routine specified
by the call to CF_RegisterChanMgr. The application
specifies an ID for this
transaction. This ID is passed to the callback
routine or posted in a message.
CF_AcceptChannel A peer application can issue CF_AcceptChannel in
response to a
CFM_CHAN_OPEN_NTFY message that has been received.
The result of the
CF_AcceptChannel call is a one-way network channel
for receiving data.
CF_RejectChannel This routine rejects a CFM_CHAN_OPEN_NTFY from the
peer.
CF_RegisterChanHandler This function registers a callback or an application
window whose
message processing function will handle
notifications generated by TII
network channel IO activities. The channels that are
opened will
receive TII CHAN_DATA_SENT notifications, and the
channels that
are accepted will receive TII CHAN_RCV_COMPLETE
notifications.
CF_CloseChannel This routine will close a network channel that was
opened by
CF_AcceptChannel or CF_OpenChannel. The handler for
this channel is
automatically de-registered.
CF_SendData Send data to peer. If the channel is not reliable
and there are no receive
buffers posted on the peer machine, the data will be
lost.
CF_RecvData Data is received through this mechanism. Normally
this call is issued in order
to post receive buffers to the system. When the
system has received data in
the given buffers, the Channel Handler will receive
the TII
CHAN_RCV_COMPLETE notification.
CF_GetChanInfo This function will return various statistical
information about a channel. For
example: bandwidth information, number of
sends/second, number of
receives/second, etc.
These functions are defined in further detail later in this specification in APPENDIX A entitled "Conference Manager API." In addition, conferencing API 506 supports the following messages returned to conferencing applications 502 and 504 from the video, comm, and audio subsystems in response to some of the above-listed functions:
CFM_CALL_NTFY Indicates that a call request initiated from the
remote site has been
received.
CFM_PROGRESS_NTFY Indicates that a call state/progress notification
has been received from
the local phone system support.
CFM_ACCEPT_NTFY Indicates that the remote site has accepted the call
request issued
locally. Also sent to the accepting application when
CF_AcceptCall
completes.
CFM_REJECT_NTFY Indicates that the remote site has rejected or the
local site has failed to
make the call.
CFM_HANGUP_NTFY Indicates that the local or remote site has hung up
the call.
CFM_UNINIT_NTFY Indicates that uninitialization of comm subsystem
has completed.
CFM_ERROR_NTFY Indicates that a SESS_ERROR was received from comm
subsystem.
Referring now to FIG. 8, there is shown a representation of the conferencing call finite state machine (FSM) for a conferencing session between a local conferencing system (i.e., caller) and a remote conferencing system (i.e., callee), according to a preferred embodiment of the present invention. The possible conferencing call states are as follows:
CCST_NULL Null State - state of uninitialized caller/callee.
CCST_IDLE Idle State - state of caller/callee ready to make/
receive calls.
CCST_CALLING Calling state - state of caller trying to call callee.
CCST_CALLED Called state - state of callee being called by caller.
CCST_ACCEPTING Accepting state - state of accepting call from
caller.
CCST_CONNECTED Call state - state of caller and callee during
conferencing session.
CCST_CLOSING A hangup or call cleanup is in progress.
At the CCST_CONNECTED state, the local application may begin capturing, monitoring, and/or sending the local audio/video signals to the remote application. At the same time, the local application may be receiving and playing the remote audio/video signals. Referring now to FIG. 9, there is shown a representation of the conferencing stream FSM for each conferencing system participating in a conferencing session, according to a preferred embodiment of the present invention. The possible conferencing stream states are as follows:
CSST_INIT Initialization state - state of local and remote streams
after CCST_CONNECTED state is first reached.
CSST_ACTIVE Capture state - state of local stream being captured.
Receive state - state of remote stream being received.
CSST_FAILURE Fail state - state of local/remote stream after resource
failure.
Conferencing stream FSM represents the states of both the local and remote streams of each conferencing system. Note that the local stream for one conferencing system is the remote stream for the other conferencing system. In a typical conferencing session between a caller and a callee, both the caller and callee begin in the CCST_NULL call state of FIG. 8. The conferencing session is initiated by both the caller and callee calling the function CF_Init to initialize their own conferencing systems. Initialization involves initializing internal data structures, initializing communication and configuration information, and verifying the local user's identity. The CF_Init function takes both the caller and callee from the CCST_NULL call state to the CCST_IDLE call state. The CF_Init function also places both the local and remote streams of both the caller and callee in the CSST_INIT stream state of FIG. 9. Both the caller and callee call the CF_CapMon function to start capturing local video and audio signals and playing them locally, taking both the caller and callee local stream from the CSST_INIT stream state to the CSST_ACTIVE stream state. Both the caller and callee may then call the CF_ControlStream function to control the local video and audio signals, leaving all states unchanged. The caller then calls the CF_MakeCall function to initiate a call to the callee, taking the caller from the CCST_IDLE call state to the CCST_CALLING call state. The callee receives and processes a CFM_CALL_NTFY message indicating that a call has been placed from the caller, taking the callee from the CCST_IDLE call state to the CCST_CALLED call state. The callee calls the CF_AcceptCall function to accept the call from the caller, taking the callee from the CCST_CALLED call state to the CCST_ACCEPTING call state. The caller and callee receive and process a CFM_ACCEPT_NTFY message indicating that the callee accepted the call, taking the caller and callee from the CCST_CALLING/CCST_ACCEPTING call states to the CCST_CONNECTED call state. Both the caller and callee then call the CF_PlayRcvd function to begin reception and play of the video and audio streams from the remote site, leaving all states unchanged. Both the caller and callee call the CF_SendStream function to start sending the locally captured video and audio streams to the remote site, leaving all states unchanged. If necessary, both the caller and callee may then call the CF_ControlStream function to control the remote video and audio streams, again leaving all states unchanged. The conferencing session then proceeds with no changes to the call and stream states. During the conferencing session, the application may call CF_Mute, CF_PlayStream, or CF_SendStream. These affect the state of the streams in the audio/video managers, but not the state of the stream group. When the conferencing session is to be terminated, the caller calls the CF_HangupCall function to end the conferencing session, taking the caller from the CCST_CONNECTED call state to the CCST_IDLE call state. The callee receives and processes a CFM_HANGUP_NTFY message from the caller indicating that the caller has hung up, taking the callee from the CCST_CONNECTED call state to the CCST_IDLE call state. Both the caller and callee call the CF_DestroyStream function to stop playing the remote video and audio signals, taking both the caller and callee remote streams from the CSST_ACTIVE stream state to the CSST_INIT stream state. Both the caller and callee also call the CF_DestroyStream function to stop capturing the local video and audio signals, taking both the caller and callee local streams from the CSST_ACTIVE stream state to the CSST_INIT stream state. This described scenario is just one possible scenario. Those skilled in the art will understand that other scenarios may be constructed using the following additional functions and state transitions: If the callee does not answer within a specified time period, the caller automatically calls the CF_HangupCall function to hang up, taking the caller from the CCST_CALLING call state to the CCST_IDLE call state. The callee calls the CF RejectCall function to reject a call from the caller, taking the callee from the CCST_CALLED call state to the CCST_IDLE call state. The caller then receives and processes a CFM_REJECT_NTFY message indicating that the callee has rejected the caller's call, taking t | ||||||
