Agent

Method and apparatus for content processing and routing

6216173

Abstract

A method and apparatus for incorporating content processing and content routing intelligence into networks. In one embodiment, the content processing and routing (CPR) system is aware of the content and requirements of data and service requests, as well as the capabilities of all services accessible via the system. Efficient network routing is accomplished by considering the capabilities of the available transmission channels, and the transmission needs of all current transmission service requests. Service requests are routed to the most suitable service or combination of services to fulfill the request. A mechanism is also provided for transparently converting data to accommodate data format differences between clients and services. In one embodiment, the CPR system comprises a system kernel consisting of the core software modules that are required to load, initialize and start CPR services, and allow the services to communicate securely. The CPR services conform to several general service types. These types include application services which act as the interface between a specific external application or device and the CPR system; kernel services which provide services on behalf of the kernel; content services which act on information in transit through the CPR system; routing services which contain the routing logic specific to a particular application; and link services which provide for the joining of two CPR instances over a network or other transmission channel. Data exchange is supported for bounded data in the form of media objects and unbounded data in the form of media streams.


Claims

What is claimed is:

1. Computer system apparatus comprising:

a network comprising at least one node, each node having a plurality of services that transmit data and service requests amongst each other as media objects, said plurality of services comprising:

at least one kernel service comprising a kernel router service, wherein said kernel router service routes media objects between each service within said node;

at least one application service, each application service forming an interface between an external application and said node for the exchange of said data and service requests; and

at least one content service, each content service providing processing of said data internal to said node.

2. The apparatus of claim 1, wherein said node further comprises at least one routing service, each routing service specifying an application-specific service route for transmitting and processing said data in said network.

3. The apparatus of claim 1, wherein said at least one kernel service further comprises a kernel stream service for setting up stream buffers between services that support unbounded data.

4. The apparatus of claim 1, further comprising at least one link service, each link service capable of forming a communication link with a corresponding link service in another node.

5. The apparatus of claim 1, wherein said at least one kernel service further comprises a service locator service, said service locator service maintaining a database comprising:

information about the location, identity and capabilities of services in said network; and

a list of service calls supported by each service.

6. The apparatus of claim 1, wherein said at least one kernel service further comprises a service locator service, said service locator service maintaining a directory comprising:

information about the location, identity and capabilities of services in said network; and

a list of service calls supported by each service.

7. The apparatus of claim 1, wherein said at least one kernel service further comprises a service monitor that tracks the status of services running on said node.

8. The apparatus of claim 7, wherein said service monitor monitors services running on a remote node by performing updates via service requests to and from a service monitor running on said remote node.

9. The apparatus of claim 1, wherein said at least one kernel service comprises a capability-based service request service which resolves a service route for service requests based on attributes associated with said service requests and capabilities associated with said plurality of services.

10. The apparatus of claim 1, further comprising an application service forming an interface between a device and said node.

11. The apparatus of claim 1, wherein said at least one content service performs analysis of said data in transit through said network.

12. The apparatus of claim 1, wherein said at least one content service examines said data to determine attributes associated with the content of said data.

13. The apparatus of claim 1, wherein said at least one content service converts said data from a first format to a second format.

14. The apparatus of claim 1, wherein said at least one content service modifies said data in transit through said network.

15. The apparatus of claim 1, wherein said at least one content service combines a plurality of data input formats into a single output format.

16. The apparatus of claim 1, wherein said at least one content service replicates at least one data input format to provide a plurality of data output formats.

17. The apparatus of claim 1, wherein said at least one content service terminates data.

18. The apparatus of claim 1, wherein said at least one content service converts a plurality of data input formats into a plurality of data output formats different from said data input formats.

19. The apparatus of claim 1, wherein said at least one content service separates a data input format into multiple output formats derived from said data input format.

20. The apparatus of claim 1, further comprising a kernel having a plurality of management modules accessible to said plurality of services via function calls.

21. The apparatus of claim 20, wherein said plurality of management modules comprise a boot manager which loads and starts other management modules.

22. The apparatus of claim 20, wherein said plurality of management modules comprise a monitor manager which monitors execution threads created in the node.

23. The apparatus of claim 20, wherein said plurality of management modules comprise a logging manager which handles message logging.

24. The apparatus of claim 20, wherein said plurality of management modules comprise a storage manager which handles storage of configuration information.

25. The apparatus of claim 20, wherein said plurality of management modules comprise a queue and stream manager which manages object queues and stream buffers for the input and output of media objects and media streams, respectively, from each of said plurality of services.

26. The apparatus of claim 20, wherein said plurality of management modules comprise a remote service call manager which handles encapsulation of service requests into media objects for a sending service, and which handles unpackaging of said service requests from said media objects for a receiving service.

27. The apparatus of claim 20, wherein said plurality of management modules comprise a configuration manager which loads and starts said plurality of services.

28. The apparatus of claim 20, wherein said plurality of management modules comprise a link manager, said link manager comprising a compression module manager, an encryption module manager and an authentication manager.

29. The apparatus of claim 20, wherein said plurality of management modules comprise an object handler, said object handler used by said plurality of services to read, write and delete said data from said media objects.

30. A method for incorporating content processing and content routing intelligence into networks, comprising:

forming a network comprising a plurality of nodes;

within each node,

forming an interface between an external application and said node by providing an application service for the exchange of data and service requests;

within a content service, processing said data in transit through said network; and

routing said data and service requests between each service in said node via a kernel router service.

31. The method of claim 30, further comprising specifying in a routing service an application-specific service route for transmitting and processing said data in said network.

32. The method of claim 30, further comprising setting up, via a kernel stream service, stream buffers between services that support unbounded data.

33. The method of claim 30, wherein said kernel router service routes said data and said service requests in the form of media objects.

34. The method of claim 30, further comprising:

maintaining information about the location, identity and capabilities of services in said network; and

maintaining a list of service calls supported by each service.

35. The method of claim 34, further comprising resolving a service route for service requests based on attributes associated with said service requests and said capabilities associated with said plurality of services.

36. The method of claim 30, further comprising, within each node, monitoring the status of services running on said node.

37. The method of claim 36, further comprising, within each node, monitoring the status of services running on a remote node by performing updates via service requests to and from a monitoring service on said remote node.

38. The method of claim 30, further comprising forming an interface between a device and said node by providing another application service for the exchange of said data and said service requests.

39. The method of claim 30, wherein said step of processing said data in transit through said network comprises performing analysis on said data.

40. The method of claim 30, wherein said step of processing said data in transit through said network comprises examining said data to determine attributes associated with the content of said data.

41. The method of claim 30, wherein said step of processing said data in transit through said network comprises converting said data from a first format to a second format.

42. The method of claim 30, wherein said step of processing said data in transit through said network comprises separating said data into separate data elements.

43. The method of claim 30, wherein said step of processing said data in transit through said network comprises combining separate data elements into a single data element.

44. The method of claim 30, wherein said step of processing said data in transit through said network comprises replicating at least one data input format to provide a plurality of data output formats.

45. The method of claim 30, wherein said step of processing said data in transit through said network comprises terminating data.

46. The method of claim 30, wherein said step of processing said data in transit through said network comprises converting a plurality of data input formats into a plurality of data output formats different from said data input formats.

47. The method of claim 30, further comprising, within each node, providing a plurality of management modules accessible to services in said node via function calls.

48. The method of claim 47, further comprising loading and starting said plurality of management modules via a boot manager.

49. The method of claim 47, further comprising, within each node, monitoring execution threads created in said node via a monitor manager.

50. The method of claim 47, further comprising, within each node, logging messages via a logging manager.

51. The method of claim 47, further comprising, within each node, handling storage of configuration information via a storage manager.

52. The method of claim 47, further comprising, within each node, managing object queues and stream buffers for the input and output of media objects and media streams from each service via a queue and stream manager.

53. The method of claim 47, further comprising:

within each node, in a remote service call manager,

encapsulating service requests within media objects for a sending service; and

unpackaging said service requests from said media objects for a receiving service.

54. The method of claim 47, further comprising, within each node, loading and starting said services via a configuration manager.

55. The method of claim 47, further comprising, within each node, each service using an object handler to read data from, write data to and delete data from a media object.

56. The method of claim 47, further comprising, within each node, providing a compression module manager to load a compression module and to manage compression and decompression of data transmitted between nodes.

57. The method of claim 47, further comprising, within each node, providing an encryption module manager to load an encryption module and to manage encryption and decryption of data transmitted between nodes.

58. The method of claim 47, further comprising, within each node, providing an authentication manager to manage authentication of data transmitted between nodes.

59. The method of claim 30, further comprising, in said node, forming a communication link with another node via a link service.

60. A computer program product comprising:

a computer usable medium having computer readable program code embodied therein for incorporating content processing and content routing intelligence into a network having a plurality of nodes, within each node, said computer program product comprising:

computer readable program code configured to cause a computer to form an interface between an external application and said node by providing an application service for the exchange of data and service requests;

computer readable program code configured to cause a computer to process, within a content service, said data in transit through said network; and

computer readable program code configured to cause a computer to route said data and said service requests between each service in said node via a kernel router service.

61. The computer program product of claim 60, further comprising computer readable program code configured to cause a computer to specify in a routing service an application-specific service route for transmitting and processing said data in said network.

62. The computer program product of claim 60, further comprising computer readable program code configured to cause a computer to set up, via a kernel stream service, stream buffers between services that support unbounded data.

63. The computer program product of claim 60, wherein said kernel outer service routes said data and said service requests in the form of media objects.

64. The computer program product of claim 60, further comprising:

computer readable program code configured to cause a computer to maintain information about the location, identity and capabilities of services in said network; and

computer readable program code configured to cause a computer to maintain a list of service calls supported by each service.

65. The computer program product of claim 64, further comprising computer readable program code configured to cause a computer to resolve a service route for service requests based on attributes associated with said service requests and said capabilities associated with said plurality of services.

66. The computer program product of claim 60, further comprising computer readable program code configured to cause a computer to monitor the status of services running on said node.

67. The computer program product of claim 66, further comprising computer readable program code configured to cause a computer to monitor the status of services running on a remote node by performing updates via service requests to and from a monitoring service on said remote node.

68. The computer program product of claim 60, further comprising computer readable program code configured to cause a computer to form an interface between a device and said node by providing another application service for the exchange of said data and said service requests.

69. The computer program product of claim 60, wherein said computer readable program code configured to cause a computer to process said data in transit through said network comprises computer readable program code configured to cause a computer to perform analysis on said data.

70. The computer program product of claim 60, wherein said computer readable program code configured to cause a computer to process said data in transit through said network comprises computer readable program code configured to cause a computer to examine said data to determine attributes associated with the content of said data.

71. The computer program product of claim 60, wherein said computer readable program code configured to cause a computer to process said data in transit through said network comprises computer readable program code configured to cause a computer to convert said data from a first format to a second format.

72. The computer program product of claim 60, wherein said computer readable program code configured to cause a computer to process aid data in transit through said network comprises computer readable program code configured to cause a computer to separate said data into separate data elements.

73. The computer program product of claim 60, wherein said computer readable program code configured to cause a computer to process said data in transit through said network comprises computer readable program code configured to cause a computer to combine separate data elements into a single data element.

74. The computer program product of claim 60, wherein said computer readable program code configured to cause a computer to process said data in transit through said network comprises computer readable program code configured to cause a computer to replicate at least one data input format to provide a plurality of data output formats.

75. The computer program product of claim 60, wherein said computer readable program code configured to cause a computer to process said data in transit through said network comprises computer readable program code configured to cause a computer to terminate data.

76. The computer program product of claim 60, wherein said computer readable program code configured to cause a computer to process said data in transit through said network comprises computer readable program code configured to cause a computer to convert a plurality of data input formats into a plurality of data output formats different from said data input formats.

77. The computer program product of claim 60, further comprising computer readable program code configured to cause a computer to provide a plurality of management modules accessible to services in said node via function calls.

78. The computer program product of claim 77, further comprising computer readable program code configured to cause a computer to load and start said plurality of management modules via a boot manager.

79. The computer program product of claim 77, further comprising computer readable program code configured to cause a computer to monitor execution threads created in said node via a monitor manager.

80. The computer program product of claim 77, further comprising computer readable program code configured to cause a computer to log messages via a logging manager.

81. The computer program product of claim 77, further comprising computer readable program code configured to cause a computer to handle storage of configuration information via a storage manager.

82. The computer program product of claim 77, further comprising computer readable program code configured to cause a computer to manage object queues and stream buffers for the input and output of media objects and media streams from each service via a queue and stream manager.

83. The computer program product of claim 77, further comprising:

computer readable program code configured to cause a computer to, in a remote service call manager,

encapsulate service requests within media objects for a sending service; and

unpackage said service requests from said media objects for a receiving service.

84. The computer program product of claim 77, further comprising computer readable program code configured to cause a computer to load and start said services via a configuration manager.

85. The computer program product of claim 77, further comprising computer readable program code configured to cause a computer to read data from, write data to and delete data from a media object via an object handler.

86. The computer program product of claim 77, further comprising computer readable program code configured to cause a computer to provide a compression module manager to load a compression module and to manage compression and decompression of data transmitted between nodes.

87. The computer program product of claim 77, further comprising computer readable program code configured to cause a computer to provide an encryption module manager to load an encryption module and to manage encryption and decryption of data transmitted between nodes.

88. The computer program product of claim 77, further comprising computer readable program code configured to cause a computer to provide an authentication manager to manage authentication of data transmitted between nodes.

89. The computer program product of claim 60, further comprising computer readable program code configured to cause a computer to form a communication link with another node via a link service.


Description

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to the field of computer-related systems, and more particularly to a software platform for incorporating content-processing and content-routing intelligence into networks.

Portions of the disclosure of this patent document contain material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure as it appears in the Patent and Trademark Office file or records, but otherwise reserves all copyright rights whatsoever.

2. Background Art

Computers and computer networks are used to exchange information in many fields such as media, entertainment, commerce, and telecommunications, for example. Media and entertainment information may include the digitized content of movies, video, audio CD's, radio, newspapers, books, magazines, and computer games. Commerce information includes electronic banking and bill payment, as well as electronic purchases. Voice telephone transmissions and video conferencing are examples of telecommunication information. The exchange of information between computers typically occurs between a "server application" that provides information or services, and a "client application" or device that makes requests of the server application and receives the provided information and services. Multiple server applications are sometimes available on a "service system". A problem with current systems is the difficulty and complexity of delivering the information in the format required by the different client applications or devices, and the difficulty and complexity of determining the best route the information should take to move from a server application to a client application or device. This problem can be understood by reviewing current systems.

Software service systems have been developed to provide mechanisms for client applications and devices to access the services of a server application. However, these service systems have difficulty in servicing the requirements of a very large number of client applications and do not provide re-usability of information processing and content routing technology for applications other than those for which they are specifically designed. Also, there are many different types and formats of information to be transmitted over the same network. Current systems do not provide arbitration or scheduling prioritization based on user or application requirements between information types being transmitted over a network. Further, routing is not based on the actual content of information being transferred. Rather it is based only on certain well-defined, limited attributes such as originator address, destination address, priority, size of object and type of packet of data. Such attributes do not lead to the most efficient transmission of information in mixed usage networks.

Another disadvantage is that client applications must have knowledge of how to communicate with specific server applications to facilitate the location and access of the respective services. This makes the addition of new service applications or devices difficult because client applications must be reconfigured or reprogrammed to recognize the new server applications and to direct service requests to those new applications. There is no mechanism in the service system to allow new services to be added without such reconfiguring or reprogramming.

Another problem is that information to be transmitted may be in one of many different data encoding formats and may be transmitted as bounded data, in the form of objects, files, etc., or as unbounded data in the form of data streams. In prior art service systems, applications using one data encoding format or bounded/unbounded transmission format cannot access the services of another application using a different data encoding format or bounded/unbounded transmission format without the use of a gateway or converter built specifically for that purpose. There is no extensible and re-usable mechanism for resolving communication between the client and server applications, and, further, the underlying service system may support only one transmission format.

CORBA and OLE/COM

Networked object technologies, such as CORBA (Common Object Request Broker Architecture) and OLE/COM (Object Linking and Embedding/Component Object Model), allow applications access to networked objects and their shared services. CORBA is designed to allow different object systems from multiple vendors to interact with each other on a network.

The CORBA system implements an Object Request Broker (ORB) providing for the location and execution of objects through a standard interface protocol, enabling objects and programs to interact with each other across the network. In the CORBA environment, an ORB daemon process (ORBD) receives object calls from the client processes registered to it. The ORB daemon then locates the object on the network, and acts as the interface between the client process and the networked object.

The OLE/COM system supports marshalling of function calls to remote objects using the lightweight remote procedure call format (LRPC). Proxy/stub pair remoting code, defined using IDL (interface definition language), is maintained to service standard marshalling calls. The OLE/COM system includes an object server registry for locating an appropriate object server for a given object class ID. Information regarding what methods an object interface supports, and the types of parameters required by each method, may be obtained from a type library.

In both CORBA and COM, client applications designate a particular server object, or object class, as the target of a function call. To accommodate calls to a new service, the client application must be reconfigured or reprogrammed to send function calls to the new service. There is little flexibility as to which object responds to a function call, as the target service is predetermined by the client application. To determine what other services are available in the system, the client application itself must interrogate objects. This sort of interrogation assumes inherent knowledge of those objects. Further, if similar services are provided in the system, there is no mechanism for selecting between the services. Only that service which is designated in the function call may be accessed, even if another service better suited to the task at hand is available.

The CORBA and COM systems allow for single-source/single-destination communication and are oriented around communication between distributed processing logic rather than supporting the movement and distributed processing of content. That is, a client application may access only one service at a time. More complex service communications with multiple service destinations, such as directing a service request to visit multiple services in sequence, is not supported. To accomplish a similar function, a client must access a first service, receive a response from the first service, forward the first response to the second service, receive a second response from the second service, forward the second response to a third service, etc. It is inefficient for the client to issue multiple service requests in this manner and it usually also creates unnecessary additional network traffic.

ROUTING SYSTEMS

The service systems of the prior art typically rely on low-level systems to route information between parties (computers, applications, etc.). These low-level systems are typically hardware systems with little or no knowledge about the type of information being transmitted or of the relative requirements of one type of transmitted information over another. Thus, there is no mechanism to control routing at the application level where such knowledge exists.

Typical routing systems of the prior art, such as routers manufactured by Cisco Systems, Inc. of San Jose, Calif., operate only at a low level. These systems perform routing based on the network packet type, originating address, destination address, port, priority, tag, size of object and type of packet of data. Dedicated hardware solutions include video routing hardware, splitters, and switches. Those hardware solutions are inflexible, expensive, non-scalable, and suited solely to the task for which they are designed.

In addition to dedicated hardware solutions, general purpose hardware is combined with dedicated software, such as with gateway software or application bridges. For instance, a database gateway may provide conversion from SQL (structured query language) format to proprietary formats, and a four-way H.320 bridge can allow four H.320 video conferencing devices to communicate, with each terminal viewing the other three. Those dedicated software solutions are of limited utility, beyond their specific design purpose.

In the prior art, networks are typically used very inefficiently when multiple digitized information types are being transmitted across a single network simultaneously. For example, current network applications and devices usually request network bandwidth on demand, regardless of the competing requirements of other applications and devices that need to share the available bandwidth. Even in technologies such as ATM (asynchronous transfer mode) switches, which allow applications to make more specific requests of the network (e.g., to provide limited but constant bit rate bandwidth), no consideration is given to the relative requirements of other applications that also need to use the network. Also, when multiple networks are available between a server application and a client application, the network actually used normally is selected based exclusively on configuration settings. That is inefficient because the most appropriate network for transmission may only be determinable at the time of transmission of information.

BACKGROUND REFERENCES

The following U.S. patents pertain to routing and media distribution:

U.S. Pat. No. 5,509,123, issued to Dobbins, is directed to an object-oriented packet routing system which utilizes common protocol-independent base objects to instantiate protocol specific objects, and which distributes the critical function and system behavior into autonomous objects. The system supports multiple network and routing protocols.

U.S. Pat. Nos. 5,251,205 and 5,430,727, issued to Callon, are directed to routing algorithms that support multiple protocols. The method includes a determination of nearest neighbor routers and their respective packet format support capabilities for use in determining network transmission paths. Multi-protocol routers are used to forward packets of differing formats, such as IP (internet protocol) and OSI (open systems interconnection) formats, to the nearest router that is in the desired transmission path and that also supports the packet format of each respective packet.

In Callon '205 and '727, when the nearest routers do not support a given packet format, the packet data is encapsulated into a supported format and forwarded. The new encapsulated packet is given a dummy address which another router in the transmission path can interpret as indicating an encapsulated packet. The encapsulated packet is extracted and routed to the designated end system or another router.

U.S. Pat. Nos. 5,423,002 and 5,583,997, issued to Hart, disclose a system for transparently extending network resources, such as the multi-protocol routing functionality of a router, to a remote LAN (local area network). From the perspective of the end systems on interconnected LANs, a "routing adapter" and a "boundary router" provide the same functionality as two interconnected routers. A small site LAN may install a routing adapter which operates independently of the higher level protocol suites. The boundary router at the local LAN provides the higher level protocol suite services to the remote LAN by way of a direct communication link and the routing adapter.

U.S. Pat. No. 5,434,863, issued to Onishi, discloses an internetworking apparatus for performing routing and packet transmission. The apparatus comprises one or more routing accelerators for assisting a main processor to perform routing. The routing accelerator subjects reception packet data to routing and transmits the data to other routing accelerators if necessary. The routing accelerator discriminates the type of the data frame, and, where the data frame is not of a routable protocol, the data is transmitted to other routing accelerators to perform bridge operations. The main processor acts as a routing manager for the internetworking apparatus, and distributes the routing table to the routing accelerators. More routing accelerators may be added to the apparatus as the network size increases.

U.S. Pat. No. 5,519,704, issued to Farinacci provides a reliable transport protocol that works with unicast and multicast transmission, and a routing protocol based on the transport protocol. A technique is provided by which destinations may be labeled with authentication information or with an administrative tag that specifies a method of routing in response to policy considerations such as security, financial, reliability, application-based policy, or other policy reasons.

U.S. Pat. No. 5,381,527, issued to Inniss, discloses a method and system for distributing messages utilizing a data processing system. A user specifies and prioritizes alternate distribution media and associated distribution channels. In the event that the distribution of a message fails in the preferred channel, the system automatically attempts to distribute the message via the user-specified alternate distribution channels based on the priorities specified by the user.

U.S. Pat. No. 5,473,599, issued to Li, is directed to network systems having redundant routers for receiving packets from a host on a LAN. Data packets are routed from a host on a LAN through a virtual address belonging to a group of routers. The group of routers comprise an active router and a standby router. The active router handles all data packets processed through the virtual address. If the active router becomes inoperative, the standby router takes over as the active router. The other routers in the group hold an election to determine a new standby router.

U.S. Pat. No. 5,517,620, issued to Hashimoto, discloses a system for dynamically updating routing information for routing packets between LANs connected to a plurality of routers via a public network. A local router comprises a protocol processor for periodically processing routing information into a local routing information protocol (RIP) datum indicative of the LANs connected to the local router. A comparator compares the RIP datum with stored information in a RIP memory, and the stored information is updated if the RIP datum is incoincident with the current stored information. The current stored RIP information is sent to other routers via a public network interface, and routing tables in each router are updated in response to the incoming RIP information.

U.S. Pat. No. 5,544,320, issued to Konrad, discloses a remote information service access system based on a client-server-service model. The service functionality is separated into a human interface service functionality, a starter service functionality, and a desired utility service functionality. The functionality is then distributed between a local host and a remote host in a manner transparent to the user.

U.S. Pat. No. 5,553,289, issued to Johnson, provides a method for automatically assigning attributes, such as "Private--Audio Content," to multimedia distributions. Specific attributes are associated with specific types of media. The distribution is searched to determine the types of media being distributed, and those attributes associated with the media types contained in the distribution are assigned to the distribution.

U.S. Pat. No. 5,583,862, issued to Callon, discloses a method and apparatus for routing for virtual networks. Routing tables are maintained in routers or gateways which identify whether or not a destination is directly reachable by the router listed in the routing information entry, or whether the destination is part of a virtual network served by the listed destination routers. Routers in communication with a virtual network are first queried for the identity of a particular destination router address before packets are delivered to eliminate the need of packet forwarding.

U.S. Pat. No. 5,608,726, issued to Virgile, discloses a system and method for routing multicast packets in a subnetwork so as to conserve bandwidth in at least some of the network segments or collision domains of the subnetwork. Multicast packets are only retransmitted in the network segments that are on a path to a host that is a member of the multicast group of hosts to which the multicast packet is directed.

SUMMARY OF THE INVENTION

The invention provides a method and apparatus for incorporating content processing and content routing intelligence into networks. In one embodiment, the content processing and routing (CPR) system is aware of the content and requirements of data and service requests, as well as the capabilities of all services accessible via the system. Efficient network routing is accomplished by considering the capabilities of the available transmission channels, and the transmission needs of all current transmission service requests. Also, service requests are able to be cast without specifying a particular service to fulfill the request. A service request is routed to the most suitable service or combination of services to fulfill the request. This permits services to be added to the system without reconfiguration or reprogramming existing applications. The CPR system also provides a mechanism for transparently converting data to accommodate data format differences between clients and services.

In one embodiment, the CPR system comprises a system kernel consisting of core software modules that are required to load, initialize and start CPR services, and that allow the services to communicate securely. The CPR services conform to several general service types. These types include (1) application services that act as the interface between a specific application and the CPR system; (2) kernel services that provide services on behalf of the kernel, including service location and routing resolution; (3) content services that act on information in transit through the CPR system, including providing data conversions; (4) routing services that contain the routing logic specific to a particular application, such as broadcasting to a subscriber list; and (5) link services that provide for the joining of two CPR instances over a network or other transmission channel. Each service implementation of these general types performs a particular task or set of tasks and supports a standard set of software interfaces, such that the kernel and other services are able to call functions within the service.

Data exchange is supported for bounded data in the form of media objects and unbounded data in the form of media streams. An object handler kernel component is provided so that each service may uniformly read, write or delete data in a media object. Service requests are communicated between services in the form of remote service calls (RSCs) which are encapsulated within media objects. A remote service call manager kernel component packs and unpacks remote service calls from media objects and interfaces with services to issue the remote service call as direct function calls.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of component interaction in the system according to an embodiment of the invention.

FIG. 2 is a diagram illustrating the interaction between services and the kernel with respect to queuing and object passing according to an embodiment of the invention.

FIG. 3 is a diagram illustrating interaction between services and the kernel with respect to logging of messages according to an embodiment of the invention.

FIG. 4 is a diagram illustrating an embodiment of an information flow between services in the system of the present invention.

FIGS. 5A and 5B are block diagrams illustrating the flow of remote service call objects between services and the kernel router in an embodiment of the invention. FIG. 5A illustrates object flow when the service is acting as a server, and FIG. 5B illustrates object flow when the service is acting as a client.

FIG. 6 is a block diagram illustrating the communication of media objects between two instances of the content processing and routing system according to an embodiment of the invention.

FIG. 7 is a block diagram illustrating communication of media streams between two instances of the content processing and routing system according to an embodiment of the invention.

FIG. 8 is a block diagram illustrating an embodiment of a content processing and routing (CPR) network, including conversion between object or stream types.

FIG. 9 is a block diagram illustrating an embodiment of the content processing and routing system of the invention.

FIG. 10 is a block diagram of a general purpose computer suitable for implementing a content processing and routing system embodiment of the invention.

FIG. 11 is a flow diagram illustrating an embodiment of the startup process for the kernel components.

FIG. 12 is a flow diagram illustrating an embodiment of the startup process for services.

FIG. 13 is an example embodiment of a media object.

FIG. 14 is an example of a business internet application implementing an embodiment of the invention.

FIG. 15 is an example of a business video network application implementing an embodiment of the invention.

FIG. 16 is an example of a personalized television application implementing an embodiment of the invention.

FIG. 17 is an example of an information publishing and broadcasting application implementing an embodiment of the invention.

FIG. 18 is an example of a distributed Java application implementing an embodiment of the invention.

DETAILED DESCRIPTION OF THE INVENTION

The present invention is a method and apparatus for content processing and routing. In the following description, numerous specific details are set forth to provide a more thorough description of the present invention. It will be apparent, however, to one skilled in the art, that the present invention may be practiced without these specific details. In other instances, well known features have not been described in detail so as not to obscure the present invention.

1. Hardware Embodiment of a General Purpose Computer System

An embodiment of the invention can be implemented as computer software in the form of computer readable program code executed on a general purpose computer such as illustrated in FIG. 10. A keyboard 1010 and mouse 1011 are coupled to a bi-directional system bus 1018. The keyboard and mouse are for introducing user input to the computer system and communicating that user input to central processing unit (CPU) 1013. Other suitable input devices may be used in addition to, or in place of, the mouse 1011 and keyboard 1010. I/O (input/output) unit 1019 coupled to bi-directional system bus 1018 represents such I/O elements as a printer, network communications card, modem, A/V (audio/video) I/O, etc.

The computer system of FIG. 10 also includes a video memory 1014, main memory 1015 and mass storage 1012, all coupled to bidirectional system bus 1018 along with keyboard 1010, mouse 1011 and CPU 1013. The mass storage 1012 may include both fixed and removable media, such as magnetic, optical or magnetic optical storage systems or any other available mass storage technology. Bus 1018 may contain, for example, thirty-two address lines for addressing video memory 1014 or main memory 1015. The system bus 1018 also includes, for example, a 32-bit data bus for transferring data between and among the components, such as CPU 1013, main memory 1015, video memory 1014 and mass storage 1012. Alternatively, multiplex data/address lines may be used instead of separate data and address lines.

In one embodiment of the invention, the CPU 1013 is a microprocessor manufactured by Intel, such as a processor from the 80.times.86 or Pentium processor families. Other possible microprocessors include the 680.times.0 or PowerPC 60.times. processor families manufactured by Motorola, the SPARC microprocessor from Sun Microsystems, and the DEC Alpha. However, any other suitable processor or microcomputer may be utilized. Further, the apparatus may comprise a plurality of microprocessors in a multi-processing arrangement.

Main memory 1015 is comprised of dynamic random access memory (DRAM). Video memory 1014 is a dual-ported video random access memory. One port of the video memory 1014 is coupled to video amplifier 1016. The video amplifier 1016 is used to drive the cathode ray tube (CRT) raster monitor 1017. Video amplifier 1016 is well known in the art and may be implemented by any suitable apparatus. This circuitry converts pixel data stored in video memory 1014 to a raster signal suitable for use by monitor 1017. Monitor 1017 is a type of monitor suitable for displaying graphic images.

The apparatus of FIG. 10 may be used as a stand-alone system, or the apparatus may be coupled to other similar apparatus across any type of network (e.g., LAN, WAN (wide area network), PSTN (public switched telephone network), Internet, Cable TV, etc.), or any combination thereof.

The computer systems described above are for purposes of example only. An embodiment of the invention may be implemented in any type of computer system or programming or processing environment.

2. The Content Processing and Routing (CPR) System

The invention provides a software platform for incorporating content processing and content routing intelligence into any type of network, enabling re-use of existing applications and content in a network service, and enabling more efficient use of underlying data networks. The invention also provides for developing, deploying and managing of new services across a digital network, which, in the prior art, typically requires extensive customized system development and re-engineering of existing applications and content.

Scalable support is provided for processes. Where a large amount of information has to be processed very quickly to enable an application to deliver its business objectives (e.g., real-time video processing), the invention, automatically and transparently to the host application, generates multiple instances of the process on a single processor, multiple processors and/or at other nodes in a content routing and processing (CPR) network as appropriate.

Support is provided for bounded (object type) and unbounded (streaming type) data in a single model. Traditionally, in the prior art, separate tools are required for different types of applications. The CPR system of the invention includes a queue and stream manager which can interface with any service to support applications processing either objects or streams.

Attributes are associated with every service request which allow the CPR system to obtain knowledge about the content and requirements of each service request. Further, every service registers its associated capabilities with the CPR system. The CPR system uses its knowledge about the content and requirements of a service request as well as its knowledge of the available services to make intelligent routing decisions with respect to selecting suitable services for the fulfillment of service requests and selecting and scheduling network transmissions between CPR nodes, i.e., between computers containing an active instance of the CPR system.

The invention enables applications or devices competing for access to network or processing resources to be granted access in a more efficient, calculated manner. Depending on the nature of the information type and content, there are different requirements for the data crossing the network. By understanding all of the types and content of information, the invention controls usage of network resources in a more efficient manner. The routing decisions are not made at the usual network level (e.g., based on pre-defined destination network address, resolvable named network address, packet priority, circuit priority, etc.), but are based on the content and properties of the information itself. This may be independent of the type of underlying network that provides the digital communications capabilities.

Also, many digital devices and applications in the prior art are unable to communicate with each other due to differences in information formats and communications session protocols. The invention provides a platform through which these incompatible devices and applications can communicate. CPR system components handle the conversion of information formats and the support of appropriate communications session protocols.

Content Processing and Routing (CPR) System Architecture

One embodiment of the CPR system of the invention is an object-oriented design based around a kernel. Communication between all software components outside the kernel is asynchronous and location-independent, enabling applications and services developed on the CPR platform to scale from a single processor machine to high volume, multi-processor servers in a clustered or wide-area distributed environment. The kernel consists of the core software modules that are required to load, initialize and start CPR services and allow the services to communicate securely.

The fundamental application unit of the CPR system is known as a service. There are several different types of services, though all share certain common facets. A service performs a particular task or set of tasks and supports a standard set of software interfaces, such that the kernel and other services are able to call functions within the service. The general types of services in the CPR system include: kernel services, link services, application services, content services and routing services. An instance of the CPR system can host many services of each type and multiple instances of each service. Each service may support either bounded media objects or unbounded media streams. Service requests and inter-service communication are performed using a standard call format referred to as a remote service call (RSC). These remote service calls are encapsulated in bounded media objects to conform to a standard media-object-based interface.

FIG. 9 is a general block diagram illustrating the primary components of a CPR instance, and the general means by which a CPR instance communicates with an external application and a second CPR instance. CPR instance 901A comprises kernel 902A, application service 903A, content service 904A, routing service 905A, kernel service 906A, and link service 907A. CPR instance 901B comprises kernel 902B, application service 903B, content service, 904B, routing service 905B, kernel service 906B, and link service 907B.

Each type of service (i.e., kernel service, application service, etc.) performs a separate general function for the system. Each service in CPR instance 901A is coupled to kernel 902A to share the kernel resources. Similarly, kernel 902B in CPR instance 901B is coupled to each service within CPR instance 901B. Each service shown represents a general service type, and multiple specialized services of each service type may be present in the CPR instance. Further, when necessary, multiple instances of a service may run concurrently in the CPR system.

The CPR system communicates with external applications via application services specifically designed to transport data between the respective application and the CPR system in the manner required by the application. Thus, a different application service may be required for each possible external application.

In FIG. 9, application 900 is coupled to CPR instance 901A via application service 903A. A second external application may be similarly coupled to CPR instance 901A via another application service to allow the two external applications to exchange services, as well as utilize the other services provided by the CPR instance. Thus, a single instance of the CPR system may be used as a stand-alone platform for joining applications.

A computer system containing an active CPR instance is referred to as a CPR node. CPR nodes communicate across networks to other CPR nodes via link services. A CPR network comprises one or more CPR nodes joined or capable of joining in this manner. Different link services may be provided to support communication via many different communication protocols or across many different types of networks. Link services can interface to the network at any required level, for instance ATM (layer two of the OSI seven layer stack), TCP (transmission control protocol, layer four) or MQ (message-queuing, layer seven). In FIG. 9, link service 907A is coupled to link service 907B to join CPR instances 901A and 901B. Through the link provided by link services 907A and 907B, application 900 may access the services provided by CPR instance 901B, as well as any applications joined to CPR instance 901B via application service 903B.

Application Services

An application service operates as the interface between the CPR system and a third-party application or an industry-standard information interchange interface. The task of the application service is to obtain and/or deliver information externally to the CPR environment. To a third-party application, an application service may appear to be a conventional client, a server, a peer, or a gateway.

Examples of application services include a WWW (World Wide Web)/Java service, an FTP (file transfer protocol) service, a MAPI (messaging application programming interface) service, and a DMTF (Desktop Management Task Force) service. The WWW/Java service is able to receive requests using HTTP (hypertext transport protocol) over a TCP/IP (transmission control protocol/internet protocol) network from a web browser and to return HTML (hypertext markup language) content to a browser. A CPR system can emulate a WWW server or filter HTML requests for specific information while passing general requests to a third-party web server. Any Java application may access CPR capabilities through the WWW/Java service by using remote service calls.

An FTP service is used to send and receive files to and from an FTP server over a TCP/IP network connection. A MAPI service is used to connect as a user to any e-mail system supporting the messaging API, such as Microsoft Mail, Exchange, CompuServe and Internet Mail (SMTP--simple mail transfer protocol). A DMTF service enables DMTF-compliant system management products to remotely manage and monitor one or more CPR instances.

Kernel Services

Kernel services provide services on behalf of the kernel. Kernel services have special knowledge of the CPR kernel, and the kernel has special knowledge of these kernel services to enable the kernel and the kernel services to cooperate in providing fundamental system services, such as logging, monitoring, version management, etc., that form part of the core CPR system. Examples of kernel services include the kernel router service, the service locator service, the service monitor, the capability-based service request (CBSR) service and the network resource service.

The kernel router service is responsible for the precise routing of every media object and media stream, and also validates the security and integrity of every media object that it routes. The kernel router service will be discussed in further detail later in this specification.

The service locator service provides and maintains, in a database or directory, information about the location, identity and capabilities of all known services in a CPR network, and also maintains a list of remote service calls (RSCs) supported by each known service. The database for the service locator service may comprise a complete copy of all location, identity, capability and RSC information for the CPR network stored at each CPR node in the network. Also, the database may comprise a distributed database in which information about services local to each CPR node is stored at the respective CPR node, and is accessible to the service locator services of other CPR nodes on the network via remote service calls.

The service monitor tracks the status of all CPR services running on the local CPR node, and is also capable of monitoring services running on remote CPR nodes. The monitoring of remote CPR nodes is accomplished by performing scheduled or requested updates via remote service requests to and from the service monitors of the remote CPR nodes.

The capability-based service request service permits service requests to be routed based upon quality-of-service requirements of the request rather than a fixed route to a predetermined destination service. This is accomplished by assigning attributes to service requests. In resolving the route for the service request, selection is made from those services, or combinations of services, that fulfill the capability and quality-of-service requirements of the service request. If no single service can fulfill the service request, the CBSR service resolves a piecewise resolution of the service request by determining a route through multiple services that each perform one or more functions of the service request. The capabilities of each service are detailed in the database of the service locator service, and service status may be obtained from the service monitor.

For example, if a request is made to transmit data from one location to another, the request may include attributes detailing transmission requirements, such as encryption, bandwidth, and cost requirements. To resolve the transmission route, the CBSR service determines which link services are associated with transmission channels meeting the given requirements. Content services may also be used to change data formats to accommodate format requirements of specific routes.

Once a transmission channel has been selected, a remote service call may be made to the CBSR service on the CPR node at the other end of the transmission channel to further resolve the next section of the transmission route, if required. A given route may be registered so that subsequent transmissions with the same requirements may follow the same route without the need for further CBSR route resolution. Also, the registered route may be assigned a lifetime to prevent chosen routes from becoming obsolete due to changes in available bandwidth and other dynamic channel characteristics. The following are some examples of attributes that can be assigned to service requests:

    Net/Cost                  Net/Bandwidth/Minimum
    Net/Cost/PricedByUsage    Net/Bandwidth/Average
    Net/Cost/PricedByConnection Net/Security
    Net/Cost/FixedPrice       Net/Security/Encryption
    Net/Jitter                Net/Security/Encryption/Level
    Net/Jitter/Maximum        Net/Security/Authentication
    Net/Jitter/Average        Net/Security/Authentication/Level
    Net/Latency               Net/Security/Delivery
    Net/Latency/Maximum       Net/Security/Delivery/Guaranteed
    Net/Latency/Average       Net/Security/Private
    Net/Bandwidth             Net/Security/VirtualPrivate
    Net/Bandwidth/Maximum     Net/Security/Public
    Person/Name               Person/Position
    Person/Name/English       Person/Company
    Person/Name/Japanese      Person/TelephoneNumber
    Person/Name/LastName      Person/TelephoneNumber/Home
    Person/Name/FirstName     Person/TelephoneNumber/Work
    Person/Name/Title         Person/TelephoneNumber/Mobile


By performing service requests based on respective service capabilities, it is possible to have the service request transparently fulfilled by any service meeting the capability requirements. This permits service requests to be more generalized in nature without requiring an application to have any specific knowledge of the service providers in the CPR network. Further, applications may be added to the CPR network to provide services simply by providing the necessary application service, and characterizing the capabilities of the services the application can perform. Thus, client and server applications may be plugged into the CPR network without requiring reprogramming of other applications already linked to the CPR network. Also, the capabilities base can be increased or refined by further extending or refining attributes.

The network resource service manages resources in a networking environment. Link and network-related application services make remote service calls on the network resource service to request and schedule network resources. The network resource service is able to schedule the use of network resources with consideration for the competing needs of all requesting services. Data transmission is scheduled such that those requests with stricter requirements are granted the resources needed when the less strict requirements of other requests permit. Thus, for example, situations can be avoided where smooth real-time video or audio is disrupted due to high priority e-mail or transaction traffic.

Link Services

As previously described, a link service establishes a corresponding connection with another link service on a remote CPR node to transfer information between two CPR nodes across a network connection. Any link service may support many simultaneous peer-to-peer sessions. Examples of link services are TCP/IP, SPX/IPX, RTP (UDP) and MQ Assured Object Delivery. The TCP/IP service may be used to transfer media objects between CPR nodes over a TCP/IP network. The SPX/IPX (sequenced packet exchange/internetwork packet exchange) service may be used to transfer media objects between CPR nodes over a SPX/IPX network. The RTP service uses the real-time protocol implemented within UDP (user datagram protocol) to stream media streams over IP networks. The MQ assured delivery service is used to provide assured delivery of media objects between CPR nodes. A link service can establish a connection across any type of network (e.g., LAN, WAN, PSTN, Internet, cable TV, etc.), and can interface to the network at any layer.

Also, analog and non-standard "network" connections joining two CPR nodes can be supported. For example, one link service may provide data to an international mail service, which ships the data on, for example, a floppy disk via air mail to another country, where the data is input through a floppy drive to another link service to enter another CPR node. Thus, all types of networks may be used to join CPR nodes via link services. The link service provides the means for transferring data on and off of the given transmission channel.

Content Services

A content service acts on information in transit within a CPR network. Typically, a content service modifies the media object or data stream. This may be through conversion, replication or termination. Alternatively, a content service may perform non-intrusive analysis of the information in transit and report its results. Examples of content services include: conversion of a video stream from one format to another; generation of a video stream from still images; conversion of proprietary format information into HTML suitable for WWW publishing; conversion of mainframe application data into PC application data; performance of a virus check; language translation; speech-to-text or text-to-speech translation; and performance of keyword detection within a message or file.

Also, content services may be developed for assisting the CBSR service by determining new attributes, or transforming existing attributes, associated with service requests. For example, a content service may examine the contents of a media object or stream to determine content aspects of the enclosed data that may be reflected in particular attributes. The content service then assigns those attributes to the media object or stream. The content service may also examine existing attributes on a media object or stream to determine, for instance, by accessing an attribute library, other associated attributes to assign to the object or stream. Existing attributes may also be transformed into new attributes. The case of determining new or alternate attributes based on existing attributes is particularly useful when large streams of data are involved, as it is more efficient to send only the attributes to the content service.

Occasionally, the performance of a service request may entail the separation of object or stream data into separate components for individual processing by another service. A content service may be created to perform the requisite separation of data components, and to assign appropriate attributes to each new component. The same or a new content service may then recombine the data at a later step in the fulfillment of the service request.

The CPR system provides for the encapsulation of object or stream processing functionality implemented by hardware. This encapsulation is implemented either within a content service (for media processing of in-transit information) or an application service (where an event is triggered or information is sourced). Encapsulation of hardware functionality into a CPR service enables any CPR application to make use of the specialized hardware without additional development. It also permits capabilities to be implemented in the CPR network that may not be possible in a purely software environment.

Routing Services

A routing service contains the routing logic specific to a particular application, with respect to routing media objects or streams through the appropriate CPR services to carry out sequential processing and onward delivery as required by the application. For example, a subscriber video service may implement a routing service to direct how a single video stream input is routed to a plurality of subscribing customer locations over a CPR network through multiple CPR nodes via respective link services, culminating in the output of the video stream through endpoint application services for display. This routing may include accessing a first content service to censor certain data from the media stream for particular customers, or a second content service to insert subtitles into the media stream. A routing service may route multiple media objects or streams through multiple CPR services or instances of services in parallel, enabling very high CPR system throughput.

Service Application Programming Interfaces (APIs)

A simple service interface may be used to provide a standard, simplified interface to the CPR system for those services that do not require the use of complex CPR system functionality. In one embodiment of the invention, a simple service interface supports the following API by providing an implementation for each of the function calls:

void DLLEXPORT SimpService_Initialise( . . . )

void DLLEXPORT SimpService_Start( . . . )

void DLLEXPORT SimpService_Stop( );

void DLLEXPORT SimpService_Shutdowno;

BOOL DLLEXPORT SimpService_RoutelnboundObject( . . . );

void DLLEXPORT SimpService_ProcessRSC( . . . );

void DLLEXPORT SimpService_PrepareTakeover( . . . )

void DLLEXPORT SimpService_Takeovero( );

void DLLEXPORT SimpService_PrepareHandover( );

void DLLEXPORT SimpService_Handovero( );

The Initialize( ) function call refers to the initialization of the simple service interface, and the loading of all associated services. The Shutdown( ) function call implements the controlled shutting down of the simple service interface and all associated services. The Start( ) and Stop( ) function calls are used to start and stop sessions with individual services. RoutelnboundObject( ) routes an incoming media object to the destination service served by the simple service interface, and returns a Boolean value indicating whether the media object can be routed successfully. ProcessRSC( ) is called to process a remote service call via the remote service call manager.

PrepareTakeover( ) and Takeover( ) are function calls referring to one service "taking over" for another service, for example, in the replacement of an older version of a service with a newer version. PrepareHandover( ) and Handover( ) are function calls for the service that is "handing operation over" to the service that is "taking over." These function calls allow for services to be swapped without interrupting the operation of the CPR system.

In one embodiment of the invention, in addition to any other APIs for carrying out specific functionality, services other than those using the simple service interface provide function call implementations for the following basic API:

void DLLEXPORT Service_AddnternalQueue( . . . )

void DLLEXPORT Service_AddExternalQueue( . . . )

void DLLEXPORT Service_Start( . . . )

void DLLEXPORT Service_Stop( . . . )

void DLLEXPORT Service_Shutdown( . . . )

void DLLEXPORT Service_PrepareTakeover( . . . )

void DLLEXPORT Service_Takeover( . . . )

void DLLEXPORT Service_PrepareHandover( . . . )

void DLLEXPORT Service_Handover( . . . )

The AddlnternalQueue( ) and AddExternalQueue( ) function calls are for establishing incoming and outgoing object queues for a given service. The remaining function calls are as discussed above with respect to the simple service interface.

To manage application-specific routing of media objects and the links necessary to support those routes in one embodiment of the invention, routing services support the following API:

void DLLEXPORT Service_Route_AddMediaType( . . . )

void DLLEXPORT Service_Route_AddRoute( . . . )

void DLLEXPORT Service_Route_AddSupportedType( . . . )

void DLLEXPORT Service_Route_AddRemoteAddress( . . . )

void DLLEXPORT Service_Route_AddConversion( . . . )

void DLLEXPORT Service_Route_StartSingle( . . . )

void DLLEXPORT Service_Route_ShutdownSingle( . . . )

void DLLEXPORT Service_Route_StartServiceLinks( . . . )

void DLLEXPORT Service_Route_ShutdownServiceLinks(. . .)

Link services support the following function call for adding the destination address of another CPR node accessible over a network or channel according to one embodiment of the invention.

void DLLEXPORT Service_AddExtenalRemoteAddress( . . . )

In one embodiment of the invention, streaming link services also support the following API:

void DLLEXPORT Service_Stream_AddStreamRoute( . . . )

void DLLEXPORT Service_Stream_AddRemoteAddress( . . . )

void DLLEXPORT Service_Stream_AddMediaType( . . . )

Other behavioral differences between services may be manifested by their remote service call APIs.

System Kernel Embodiment

FIG. 1 is a block diagram illustrating components of the system kernel and their interaction with each other and CPR services. Shown in FIG. 1 are eight management components resident in the kernel of the system, and a plurality of services jointly identified as element 128. Components of the system kernel are shown above dashed line 129, whereas services 128 are shown below dashed line 129. The kernel management components in the embodiment of FIG. 1 include the following: boot manager 120, logging manager 121, monitor manager 122, storage manager 123, queue and stream manager 124, remote service call (RSC) manager 125, link manager 126 and configuration manager 127. Lines coupling components in FIG. 1 represent a path of interaction between those components.

Boot manager 120 is coupled to logging manager 121, monitor manager 122, storage manager 123, and queue and stream manager 124 via lines 101, 102, 103 and 104, respectively. Boot manager 120 is also coupled to remote service call manager 125, link manager 126 and configuration manager 127 via lines 105, 106, and 107, respectively. Services 128 are coupled to logging manager 121, monitor manager 122, storage manager 123, queue and stream manager 124, remote service call manager 125, link manager 126 and configuration manager 127 via lines 112, 116, 115, 114, 113, 117 and 111, respectively. Configuration manager 127 is further coupled to logging manager 121, storage manager 123, and queue and stream manager 124 via lines 108, 110, 109, respectively.

Boot manager 120 (also referred to as the "boot loader") contains the initial start-up code for the CPR system. Boot manager 120 is responsible for starting an instance of the CPR system by loading and starting the other CPR kernel components in the correct order.

The lines between boot manager 120 and the other kernel components in FIG. 1 represent the start-up interaction. FIG. 11 illustrates one embodiment of a kernel resource startup procedure carried out by the boot manager. In step 1100, the boot manager invokes the logging manager's Start( ) method, and passes the logging manager the filename and logging level to use for internal logging, as well as the filename to use for resource messages. The logging level is used by the logging manager to filter out lower priority log messages. Those log messages whose logging level falls below the logging level stored in the logging manager are discarded.

In step 1101, the boot manager invokes the Start( ) method of the monitor manager, and passes the monitor manager an input queue handle for logging purposes, a filename to use for resource messages, and, optionally, a thread monitoring mode if more than one monitoring mode is supported. The monitor manager may be used in a multi-processor environment to determine processor affinity based on monitored thread execution behavior. The thread monitoring mode can be used to select an affinity assignment strategy.

In step 1102, the boot manager invokes the storage manager's Startup( ) method, and passes the storage manager an input queue handle for logging purposes, the filename to use for resource messages, and the local CPR node address. In step 1103, the boot manager invokes the Start( ) method of the queue and stream manager, and passes the input queue handle for logging purposes and the filename to use for resource messages. In step 1104, the boot manager invokes the Start( ) method of the remote service call manager, and passes the input queue handle for logging purposes and the filename to use for resource messages.

In step 1105, the boot manager starts the individual modules (compression, authentication, cryptographic, etc.) of the link manager by invoking their respective Start( ) methods. Each module is passed an input queue handle for logging, a filename for resource messages and the handle of a configuration file. In step 1106, the boot manager invokes the Start( ) method of the configuration manager, and passes the input queue handle for logging and the handle of a configuration file.

Referring again to FIG. 1, configuration manager 127 initializes any logs required by services through the logging manager 121 as indicated by line 108, initializes any queues required by services through queue and stream manager 124 as indicated by line 109, and initializes any storage entities required by services through the storage manager 123 as indicated by line 110. Then, as stated previously, via line 111, configuration manager 127 loads each service 128 dynamically and passes appropriate log, storage and queue handles. Each service is then started in turn.

Services 128 represent the application units of a CPR instance. Each service interacts with logging manager 121 via line 112 for logging messages to a log. Each service also uses the remote service call manager 125 for calling functions on other services and to act as a server for such functions (line 113). Queue and stream manager 124 is used by each service to pass media objects to another service via line 114. Configuration information for each service is loaded and saved via interaction with storage manager 123, as indicated by line 115. Whenever a service creates a thread, the thread is registered with monitor manager 122 via line 116. Link services interact with link manager 126, as indicated by line 117, in the process of communicating with other remote link services.

Kernel Components and APIs

Logging manager 121 is used by all CPR system components for the logging of messages. The logging manager coordinates the input of logging information from a large number of threads and processes which are imultaneously active within the CPR system. The logging manager also manages the structure and file storage of output logs. One embodiment of the logging manager API is provided below.

    Logging Manager API
    Start( );          Sets up the internal logging file and logging level, and
     begins
                       internal logging
    Stop( );           Stops internal logging
    CreateInputQueue( ); Creates an input queue for writing log strings
    CreateOutputQueue( ); Creates an output queue; the output queue may receive
     strings
                       from several input queues and write them to a file
    DeleteInputQueue( ); Deletes an input queue previously allocated
    DeleteOutputQueue( ); Deletes an output queue previously allocated
    BindQueue( );      Binds an input queue to an output queue
    WriteLog( );       Writes a message to a given input queue; messages below
     the
                       current logging level are discarded
    GetLoggingLevel( ); Retrieves the current logging level in force on an
     input queue
    BindDirect( );     Creates an input queue and binds it to a given output
     queue
    WriteEventLog( );  Writes a message to a particular event log


Whenever a service wishes to log a message to the CPR logs, the service uses the logging manager API. In one embodiment, the logging manager API methods use a separate resource DLL (dynamic link library) that contains the service's respective log messages, or resource messages, with spaces for insertion of variable text. This allows an alternate language to be used for logging without restarting the CPR instance. Also, the logging manager may write out binary versions of the log messages that do not include any text from the resource file, only the resource ID. This allows a log viewing application to display the binary log in whichever language is required.

For example, a TCP/IP link service may use the file mrtcpipres.dll as its resource DLL. Some sample resource messages that might be included in a TCP/IP link service resource DLL are:

    Message Name                            Message
    IDS_MRTCP_STARTUP                       "MRTCPIP Transport service V1.05
     Copyright
                                            (c) 1996-97 RedBox Holdings NV. All
     rights
                                            reserved."
    IDS_STARTUP_FAILED                      "This service failed to start up
     correctly.
                                            This service is unable to route
     data."
    IDS_STARTUP_WINSOCK_INIT_SUCCESS        "Windows Sockets (2.0)
     initialized."
    IDS_STARTUP_WINSOCK_INIT_FAILURE        "Error initializing Windows
     Sockets. Error
                                            was %1!d!."
    IDS_STARTUP_INVALID_CONFIG_FILE         "Error accessing the kdb file. This
     service
                                            will have no external links -
     unable to route
                                            data."
    IDS_SHUTDOWN_WINSOCK_SUCCESS            "Windows Sockets successfully
     closed."
    IDS_SHUTDOWN_WINSOCK_FAILURE            "Error closing Windows Sockets.
     Error was
                                            %1!d!."
    IDS_CONFIG_LINK_LOCAL_IP                "Link %1: Local I.P. address is
     %2."
    IDS_CONFIG_LINK_REMOTE_IP               "Link %1: Remote I.P. for this link
     is %2."
    IDS_CONFIG_LINK_SERVER_PORT             "Link %1: The server is listening
     on port
                                            %2!d!."
    IDS_CONFIG_FILE_ERROR                   "Link %1: Error in line %2."
    IDS_SERVER_START_SUCCESS                "Link %1: Server started
     successfully."
    IDS_SERVER_START_FAILURE                "Link %1: Error starting the
     server. This link
                                            will not be able to accept incoming
     data."
    IDS_SERVER_SHUTDOWN_SUCCESS             "Link %1: Server stopped
     successfully."
    IDS_SERVER_SHUTDOWN_FAILURE             "Link %1: Error stopping the
     server."
    IDS_SERVER_SOCKET_CREATE_SUCCESS        "Link %1: Server listening socket
     created
                                            successfully."
    IDS_SERVER_SOCKET_CREATE_FAILURE        "Link %1: Error creating Server
     listening
                                            socket."
    IDS_SERVER_SOCKET_NAME_FAILURE          "Link %1: Server unable to name to
     socket for
                                            client associations. Error was
     %2!d!."
    IDS_SERVER_LISTEN_SUCCESS               "Link %1: Server listening for
     network
                                            ACCEPT and CLOSE messages."


The elements %1, %2, etc. in the resource messages are replaced during message logging by data parameters specific to the event causing the message to be logged. Foreign language versions may alter the order of display of these data parameters to fit the respective language syntax of their messages.

Monitor manager 122 monitors all threads created in the respective instance of the CPR system. A mechanism is provided for specifying a thread "type" which may be used, in addition to monitoring of thread execution behavior, to more efficiently determine processor affinity for threads in a multi-processor environment. An embodiment of the monitor manager API is provided below.

    Monitor Manager API
    Start( );      Starts the monitor manager in a given mode
    Shutdown( );   Stops the monitor manager
    CreateThread( ); Creates a thread with a given stack size, start address,
                   thread ID, thread type, etc.


Storage manager 123 is used by all CPR system components for the storage of configuration information. In an embodiment of the invention, a database management scheme is used to store, retrieve and update configuration information. The storage manager API provides mechanisms for loading and closing databases, opening and closing database sessions, and retrieving, writing or deleting information from a database. One embodiment of the API is provided below.

    Storage Manager API
    Startup( );        Initializes the storage manager
    LoadConfig( );     Loads a file as a database and returns a handle
    CloseConfig( );    Closes a database and saves the data to a file
    Shutdown( );       Shuts down all configuration databases
    SetupSession( );   Starts a session with a database
    EndSession( );     Cancels a session with a database
    GetFirstAddress( ); Retrieves first unique address in database
    GetNextAddress( ); Returns next unique address for any given session
    GetFirstType( );   Retrieves the first type in a configuration for an
     address/type
                       tuple
    GetNextType( );    Retrieves next type in a configuration for the given
     session
    GetFirstService( ); Retrieves the first unique service given an address and
     type
    GetNextService( ); Retrieves the next unique service for a given session
    GetFirstName( );   Retrieves the first name in a configuration for an
                       address/type/service three-tuple
    GetNextName( );    Retrieves the next name for a session
    GetInformation( ); Retrieves info from the specified data point
    SaveInformation( ); Adds the given data to the database at the given data
     point
    DeleteInformation( ); Deletes the specified data point


In one embodiment, configuration information is stored in a Unicode text file, with fields separated by a first character delimiter, such as a comma, and records separated by a second character delimiter, such as a carriage return/line feed pair. The data itself may contain further character delimiters to separate data elements. The fields in one embodiment include: (1) the CPR address or node name; (2) the service type of information (configuration, queue configuration, encryption module configuration, etc.); (3) the data type of the information (queue, service, kernel component, log, etc.); (4) name of data type (service name, queue name, log name, etc.); (5) an update flag (typically, -1); (6) a number indicating (directly or indirectly) the length of the data; and (7) the data itself. An example record for configuring a web (HTTP) service might appear as:

CPR1,Config,SERVICE,HTTPSRV,-1,0, ; ; ;C: .backslash.cpr.backslash.bin.backslash.httpsrv.dll;

C:.backslash.cpr.backslash.bin.backslash.httpsrvres.dll; ;NORMAL; ; ; ;ROUTE;MainLog;HTTPSRVKDB; ;

wherein the node name is CPR1, the service type of information is Config, the data type is SERVICE (i.e., service configuration data), the name of the service is HTTPSRV, the update flag is enabled as "-1". The configuration data elements are delimited by semicolons, and include the pathname for the service DLL (httpsrv.dll), the pathname for the service's resource DLL (httpsrvres.dll) containing resource messages for logging, the log file name (MainLog), a separate routing database for use by the web service (HTTPSRVKDB), and other configuration parameters. Blank data elements are place holders for elements used in the configuration of other services, but unneeded for this particular service example. For instance, for services using the simple service interface, the pathname of the simple service DLL may be entered prior to the pathname of the service DLL.

Queue and stream manager 124 manages object queues within the CPR system. Object queues are the input and output queues for all media objects that are being passed to or from CPR services within a single instance of the CPR system. There are usually many such queues in a CPR instance. The queue manager transfers media objects between object queues and signals each service when a media object has arrived on its object queue. Similarly, means are provided for establishing stream buffers for unbounded stream data transmitted between services. The queue and stream manager provides a mechanism for binding services with object queues and stream buffers. The queue and stream manager also creates media objects and stream buffers. Media objects are allocated from a bank or group of media objects of a given size. An embodiment of the queue and stream manager API is provided below.

    Queue & Stream Manager API
    Start( );               Starts the queue and stream manager
    Shutdown( );            Shuts down the queue and stream manager in this
     instance
    CreateObjectBank( );    Creates a new object bank
    DeleteObjectBank( );    Deletes a specified object bank
    CreateObjectQueue( );   Creates an object queue
    ModifyObjectQueue( );   Modifies an existing object queue
    DeleteObjectQueue( );   Deletes a specified object queue
    CreateMediaObject( );   Creates a media object (allocated from an
     appropriate bank)
    LockObjectToPtr( );     Obtains the pointer to the object memory from the
     object
                            handle
    UnlockObject( );        Unlocks the object previously locked w/
     LockObjectToPtr()
    DeleteMediaObject( );   Deletes a media object allocated by
     CreateMediaObject()
    ReallocateMediaObject( ); Reallocates the size of a media object
    BindToInputQueue( );    Binds a given service with input end of a queue
    GetQueueClassType( );   Retrieves the class type of objects associated w/ a
     given queue
    PlaceObjectOnQueue( );  Places a media object on a given queue
    BindToOutputQueue( );   Binds a given service with the output end of a
     queue
    RegisterQueueSemaphore( ); Registers a semaphore object with the output end
     of a queue
    GetObjectFromQueue( );  Retrieves an object from a queue
    UnbindQueue( );         Unbinds a service from a queue
    CreateStreamBuffer( );  Creates a stream buffer with a specified maximum
     size and
                            number of channels
    DestroyStreamBuffer( ); Destroys a given stream buffer
    BindToInputStream( );   Binds a given service to the input of a given
     stream buffer
    BindToOutputStream( );  Binds a given service to the output of a given
     stream buffer
    RegisterStreamEvent( ); Registers a given event with a stream
    AddDataToStream( );     Adds data to a stream buffer
    GetDataFromStream( );   Retrieves data from a stream buffer


Remote service call (RSC) manager 125 enables simple, high performance function calls to be passed between CPR services, independently of location. The remote service call manager handles the packaging or encapsulation of function calls and parameters into media objects for delivery to the appropriate service and the unpackaging at the receiving end. The remote service call manager also manages the return and packaging/unpackaging of results as media objects. The interaction between the RSC manager and CPR services is described more fully with respect to FIGS. 2, 4, and 5A-B, later in this specification. An embodiment of the RSC manager API is provided below.

    Remote Service Call Manager API
    Start( );                    Starts the RSC manager
    Shutdown( );                 Stops the RSC manager
    Callside_Start( );           Initializes the calling side info for a
     service
    Callside_ProcessObject( );   Used to process a received RSC object at the
     calling
                                 side; returns TRUE if processed
    InitializeCall( );           Sets up a new function call
    AddParameter( );             Adds a parameter to a function
    MakeCall( );                 Makes a function call
    GetStatus( );                Tests the state of a given function call
    WaitMore( );                 Waits for a longer time for completion of a
     function
                                 call
    GetStatusDescription( );     Retrieves any description of an error state
    GetReturnValue( );           Gets a return parameter from a returned
     function
    CloseCall( );                Destroys an outbound call
    ReceiveSide_Start( );        Starts a session for responding to API calls
    ReceiveSide_ProcessMediaObject( ); Used to process an incoming media object
     at the
                                 receive side; returns TRUE if processed
    GetParameter( );             Retrieves a parameter from a function call
    GetSafeParameter( );         Same as above, but exceptions are trapped and
     the
                                 size is set to zero and the data to null
     automatically
    AddReply( );                 Adds a reply to a function call
    ReturnReply( );              Replies to a function call
    CloseReply( );               Closes a reply to a function call


Link manager 126 consists of three primary components used by link services: a compression module manager, an encryption module manager, and a terminal/authentication module manager. The compression module manager provides the management of installable compression modules used mainly by link services. The installable compression modules are kernel level components implemented to support a standard interface specification. The encryption module manager provides the management of installable encryption modules used mainly via link services. The installable encryption modules are also kernel level components implemented to support a standard interface specification. The terminal/authentication module manager provides the management of installable authentication modules which enable two link services on separate CPR nodes to determine that they are each communicating with the authentic correspondent.

Each module manager comprises an API for managing the respective component modules. These APIs further include general function calls for authentication, encryption or compression of data. However, authentication, encryption and compression are implemented within the respective component modules. The manager API passes those function calls through to the API of a given installed component module for actual processing. An embodiment of the API for the terminal/authentication module manager is provided below.

    Terminal/Authentication Module Manager (Link Manager) API
    Start( );               Starts the terminal/authentication module manager
    Stop( );                Stops the terminal/authentication module manager
    Initialize( );          Sets up all terminal services
    AddTerminalService( );  Installs a terminal service DLL (module)
    StartTerminalSession( ); Starts a terminal session of a given terminal
     service
    GetDataFromTerminal( ); Retrieves data to be sent across transmission
     channel to the
                            remote terminal
    GiveDataToTerminal( );  Passes data retrieved from the transmission channel
     to the
                            terminal
    ConvertToChannelData( ); Lets the terminal convert regular data into a form
     to place
                            on the channel
    ConvertFromChannelData( ); Lets the terminal convert channel data back to
     the data
                            buffer originated at the source terminal
    StopTerminalSession( ); Ends a terminal session


Each respective terminal/authentication module implements the following API which receives function calls passed from the terminal/authentication module manager:

Terminal_Startup( ); //starts the given terminal/authentication module

Terminal_StartTerminalSession( );

Terminal_GetDataFromTerminal( );

Terminal_GiveDataToTerminal( );

Terminal_StopTerminalSession( );

Terminal_Shutdown( ); //shuts down the given terminal/authentication module

In addition, the following type definitions are associated with the terminal/authentication module manager.

    typedef enum
    {
         KTERM_SLAVE,     / / The terminal should wait for
    communication
         KTERM_MASTER     / / The terminal should initiate the protocol
    } KTERM_TYPE;
    typedef enum
    {
         KTERM_NOTIFY_WAITING,       / / The terminal is waiting for
    the other end
         KTERM_NOTIFY_HASDATA,       / / The terminal has data it
    wishes to send over the channel
         KTERM_NOTIFY_AUTHENTICATED,      / / The terminal has
    authenticated the remote terminal
         KTERM_NOTIFY_SECURE,             / / The terminal has
    agreed on an encryption standard for the channel
    (all data should flow through the terminal)
         KTERM_NOTIFY_COMPRESS,           / / The terminal has
    agreed on a compression standard for the channel
    (all data should flow through the terminal)
         KTERM_NOTIFY_NOTAUTHENTICATED,        / / The terminal
    could not authenticate the remote terminal
         KTERM_NOTIFY_DISCONNECT               / / The terminal
    has disconnected from the channel
    } KTERM_NOTIFICATION;


This callback is in the link service:

typedef void (*PFN_TERMMAN_CALLBACK)(KTERM_HANDLE *terminal_handle, KTERM_NOTIFICATION notification_message, DWORD *notification_param, LPDWORD callback_data);

When a link service wishes to use a terminal/authentication procedure, the link service first calls the StartTerminalSession( ) function of the terminal/authentication module manager as follows:

    void DLLEXPORT KTermMan_StartTerminalSession(
         const_TCHAR *terminal_name,  / / The name of the terminal
    service
         const_TCHAR *terminal_address, / / Address of terminal
         KTERM_TYPE  terminal_type, / / Whether the terminal is
    to be the master or slave
         KTERM_HANDLE *terminal_handle  / / Will be filled with
    the handle to this terminal session
         PFN_TERMMAN_CALLBACK callback,     / / The callback to be
    used for notification of important state changes
    LPDWORD   callback_data);


Via the callback function passed to the StartTerminalSession( ) function, the link service receives notifications about the authentication process. If the authentication process requires authentication data to be sent to the remote link service, the callback function is called by the terminal/authentication module manager. The link service retrieves the authentication data from the terminal and sends it to the remote link service. When the remote link service receives the authentication data, the remote link service passes the data to the remote terminal/authentication module manager. Typically, the remote terminal will initiate a further callback from the remote link service to reply to the local terminal. After one or more rounds of sending authentication data between the local and remote terminals, the callback function is called indicating whether the link has been authenticated or not.

Embodiments of APIs for the encryption and compression module managers are provided below. The operations indicated below are, in most cases, performed by forwarding the function call to an appropriate module in which the operation is implemented.

    Encryption Module Manager (Link Manager) API
    Start( );          Starts the encryption module
    Stop( );           Stops the encryption module
    Initialize( );     Sets up all crypto services found in the configuration
     file
    AddCryptoService( ); Installs a crypto service DLL
    EncryptObject( );  Encrypts a media object
    DecryptObject( );  Decrypts an encrypted media object
    DeleteObject( );   Deletes an object created by EncryptObject() or
                       DecryptObject()
    AddPublicKey( );   Adds a public key to the database supported by the
                       encryption type
    RevokeKey( );      Revokes a key


Each respective encryption module implements the following API which receives function calls passed from the encryption module manager, and carries out the indicated operation as befits the encryption standard supported by the given module:

KCryp_Startup( ); // starts the given encryption module

KCryp_EncryptObject( );

KCryp_DecryptObject( );

KCryp_DeleteObject( );

KCryp_AddPublicKey( );

KCryp_RevokeKey( );

KCryp_Shutdown( ); // shuts down the given encryption module

    Compression Module Manager (Link Manager) API
    Start( );          Starts the compression module manager
    Stop( );           Stops the compression module manager
    Initialize( );     Sets up all compression services found in the
     configuration file
    AddCompService( ); Installs a compression service DLL
    CompressObject( ); Compresses a media object
    DecompressObject( ); Decompresses a compressed media object
    DeleteObject( );   Deletes an object created by CompressObject() or
                       DecompressObject()


Each respective compression module implements the following API which receives function calls passed from the compression module manager, and carries out the indicated operation as befits the compression standard supported by the given module:

KComp_Startup( ); // starts the given compression module

KComp_CompressObject( );

KComp_DecompressObject( );

KComp_DeleteObject( );

KComp_Shutdown( ); // shuts down the given compression module

Configuration manager 127 of FIG. 1 is used to manage the services running in a CPR instance. The configuration manager is responsible for loading and starting all CPR services, including kernel services. The start-up configuration of a CPR instance (i.e., which services get loaded, how initial resources are allocated, language of operation, etc.) is defined by a configuration script. The configuration script is retrieved by the boot manager from a database loaded by the storage manager 123, and is passed to the configuration manager by the boot manager. The configuration manager parses the configuration script to create an internal model of the CPR start-up configuration. The configuration manager then creates the appropriate resources, and loads, initializes, and starts the CPR services, as represented with line 111 in FIG. 1.

The configuration manager is also called to provide the orderly shutdown of services and deallocation of initial resources during a CPR shutdown process. The configuration manager can also perform this function dynamically, starting or stopping services during CPR system operation. An embodiment of the configuration manager API is provided below.

    Configuration Manager API
    Start( ),                    Starts the configuration manager
    Stop( );                     Stops the configuration manager
    GetVariable( );              Gets a variable defined
    GetFirstService( );          Returns details of first services currently
     active on
                                 this CPR instance
    GetNextService( );           Returns details of next service active on this
     CPR
                                 instance
    PrepareScriptFromServiceObject( ); Prepares a configuration script from a
     running service
                                 and returns the script as a string
    ScriptSetup( );              Configures a new service from a string of
     configuration
                                 information
    ServiceSetup( );             Starts up a service when CPR system is already
                                 running
    ServiceShutdown( );          Shuts down an existing service while CPR
     system
                                 continues to run


Another kernel component which is not shown in FIG. 1 is the object handler. The object handler provides a standard interface for manipulating the contents of media objects. In one embodiment, the object handler is a media object API, such as that shown below, which provides a set of capabilities that allows any CPR service to manipulate objects without explicit knowledge of their data structure.

    Object Handler API
    StartSession( );          Starts an object handler session; creates a new
     media
                              object
    EndSession( );            Ends an object handler session; deletes the media
     object
    GetObjectData( );         Copies the raw data of the media object to a
     buffer
    CompactObject( );         Compacts the data of the media object; removes
     media
                              marked as deleted
    GetTotalSize( );          Returns the total size of the media object
    Add( );                   Adds a medium to the media object
    Get( );                   Gets a medium from the media object
    Delete( );                Marks a medium in the media object as deleted
    GetFirstName( );          Retrieves the first name of the specified type,
     if present
    SingleShot_GetFirstName( ); Starts a session, retrieves first name of the
     specified type,
                              and closes the session
    GetNextName( );           Retrieves the next name of the current type
    AddName( );               Adds a name of the specified type
    GetFirstAddress( );       Retrieves the first address of the specified type
    SingleShot_GetFirstAddress( ); Starts a session, retrieves the first
     address of the
                              specified type, and closes the session
    GetNextAddress( );        Retrieves the next address of the current type
    AddAddress( );            Adds an address of the specified type
    CompressObject( );        Compresses the media object
    DecompressObject( );      Decompresses the media object
    SignObject( );            Creates a message digest for the media object and
     encrypts
                              that digest using the private key for the source
     service
    CheckSignedObject( );     Tests to see if the media object is signed using
     SignObject


A media object is the format in which all bounded data is passed between CPR services. There can be many different types of media objects, all of which share the same general structure. Examples of possible media object and media stream types are:

/Fax/FR/Outbound

/Fax/FR/Inbound

/Fax/FR/Response

/Multimedia/Combined/MPEG2System

/Multimedia/Video/MPEG2

/Multimedia/Video/AVI

/Multimedia/Video/QuickTime

/Multimedia/Image/PCX

/Multimedia/Image/PCX/4Bit

/Multimedia/Image/PCX/8Bit

/Multimedia/Image/PCX/16Bit

/Multimedia/Image/PCX/24Bit

/Multimedia/Image/BMP

/Multimedia/Image/TIFF

/Multimedia/Image/TIFF/Group3

/Multimedia/Image/TIFF/Group4

$Install/FileGrouping

$Install/InstallFile

$KRSC/OutboundCall

$KRSC/ReturnFromCall

$Debug/ObjectSpawn/TestObject

$Debug/PipePing/KSTATRequest

($ indicates internal system object types)

The above type object and stream types would be placed into the media object or stream as a name type so that the service the object or stream is directed to may know how to interpret the object or stream data. If it is a remote service call embedded in a media object, a service or the remote service call manager may determine that such is the case by using the SingleShot_GetFirstName( ) or GetFirstName( ) methods of the object handler to read the media object type.

An example embodiment of a media object is illustrated in FIG. 13. The numbers associated with the media object example are index values that refer to a particular media type. Some specific media types are: name types for identification information, address types for source/destination and routing information, and data types for the data specific to the media object type. Index values 0-99 are used to store name type information, such as the universal ID of the media object or the media object public name types listed above (e.g., "/Fax/FR/Outbound"). Specific name types are assigned to each index value, but multiple names may be added to each name type. This may be accomplished, for example, by appending each added name to the last name after insertion of a name delimiter such as the character "/". Names would thus be stored as character strings in the format "/first name/second name/etc."

Similarly, address type information, such as the source and destination CPR node addresses, are stored in index values 100-199. As with name types, each index refers to a specific address type, but multiple addresses may be entered for each address type. In the embodiment shown, index values 200-999 are reserved for other CPR system information.

Index values 1000 and beyond are used to store data type information for the media object. The mapping of particular data types to each index above 1000 is specific to the type of media object, and is known by those services handling media objects of the given type. For example, services associated with faxing that use the media object type "/Fax/FR/Outbound" may store, at a first index, data regarding the number of pages in the fax, while at second and third indices, data regarding the recipient's telephone number and resolution may be stored. At another index, the fax data itself is stored. A fax application service may extract this information by invoking the Get( ) method of the object handler and specifying the appropriate media type index. Other services in the CPR system may add, delete or alter data in the media object over the course of the media object's transit of the CPR network.

The generation of a media object is performed by first opening a session with the object handler (StartSession( )). This returns a handle to the media object which is used in all subsequent object handler method invocations. Data is then added to the media object by using the AddName( ), AddAddress( ), and Add( ) methods. When all desired name, address and data types have been filled as needed, the media object is compacted by invoking the CompactObject( ) method. This reduces the size of the media object to the actual size of the enclosed data, and removes name, address and data type items marked as deleted. After the media object has been compacted, the object may be compressed, if desired, by invoking the CompressObject( ) method. The GetObjectData( ) method is then used to place the actual data of the media object into a newly allocated variable preferably matching the size of the actual object data. The data in the variable is then sent on to the CPR system for routing and further processing. To clean up after processing the object, the variable is deleted and the object handler session is closed using the EndSession( ) method.

Service/Kernel Interaction

FIG. 12 is a flow diagram illustrating one embodiment of a general service startup procedure carried out by configuration manager 127. In step 1200 of FIG. 12, the configuration manager uses the handle of the configuration file to access the service configuration setup database in the storage manager. In step 1201, the setup information for the first service is retrieved from the service configuration setup database. Using the setup information, an input queue is created in the logging manager in step 1202. If, in step 1203, an output logging queue has been created, the procedure continues at step 1205. If an output logging queue has not yet been created, the configuration manager creates an output queue in the logging manager in step 1204, before proceeding to step 1205. In step 1205, the configuration manager binds the input logging queue to the output logging queue.

In step 1206, object queues are created for the service in the queue and stream manager, and in step 1207, the configuration manager binds the object queues to the service. In step 1208, the configuration manager starts the service, and passes the handles of the logging and object queues to the service. In step 1209, if there are no more services to start, the procedure is completed. Otherwise, the setup information for the next service is retrieved in step 1210, and the procedure returns to step 1202 for handling of the next service.

FIG. 2 is a block diagram illustrating the interaction between services and kernel components with respect to the loading of services and establishing of queue handles for the passage of media objects. FIG. 2 comprises queue and stream manager 124, remote service call manager 125, configuration manager 127 and services 128, as well as simple service interface 220 and object handler 221. Simple service interface 220 provides a simplified interface to the CPR system for those services that do not require the use of complex CPR functionality.

Configuration manager 127 interacts with queue and stream manager 124 (line 201) to create any object queues to be used by a service. If the configuration data states that the service uses the simple service interface, these queues are passed to the simple service interface module (line 202) which then loads the real service. If the configuration data states that the service is to be loaded directly, the service is loaded by configuration manager 127 (line 203), and the queue handles are passed to the service as described with respect to FIG. 12.

A service 128 can use the queue handles passed directly to the service to both receive objects from other services and to send objects to other services via line 204. Media objects that are actually remote service call objects are passed through remote service call manager 125 via line 205. Remote service call manager 125 passes the actual function call to the service via line 206. A number of queues, as represented by line 207, can be used in addition to line 204 to pass objects of various types to and from service 128. The number of queues depends on the current loading of the service.

When the service 128 uses the simple service interface 220, all the queues pass through the simple service interface 220, shown by line 208, instead of passing directly to the service 128. The simple service interface 220 then passes the objects onto service 128 (line 209) as a function call. Remote service call manager 125 interacts similarly with simple service interface 220 via line 210, as is done with service 128 via line 206. Service 128 interacts with object handler 221, as represented by line 212, in order to manipulate the contents of media objects.

FIG. 3 illustrates the interaction between CPR services and the CPR kernel for the purposes of logging. FIG. 3 includes logging manager 121, configuration manager 127, services 128, simple service interface 220, input queues 310A-310C and output queue 312. Input queues 310A, 310B, and 310C are the inbound log queues for logging manager 121. Each queue contains logged messages from a single service which need to be written to an external log file. Output queue 312 is an outbound log queue for logging manager 121. Output queue 312 contains log messages from multiple services. There may be a plurality of such output queues 312, each servicing multiple input queues.

Before loading any service, configuration manager 127 interacts with logging manager 121, as represented by line 301, to create an input log queue for each service. Configuration manager 127 also creates one or more output log queues and binds any number of the input log queues to a given output queue. The handle for the instantiated input log queue is presented to the respective service 128 either directly, as represented by line 303, or via the simple service interface 220 if appropriate, as represented by line 302. When a service 128 needs to log a message, the message is passed to logging manager 121 with the handle for the associated input queue, as represented by line 304. When simple service interface 220 is involved, the log message and the input queue handle are provided to logging manager 121 in a similar manner via lines 305A and 305B.

After receiving a message to be logged, logging manager 121 places a logged message on the appropriate input queue (310A, 310B or 310C) as represented by lines 306A, 306B or 306C, based on the handle included with the log message. Each output queue 312 has a monitor thread 311 which detects when there are messages in any bound input queue 310A, 310B or 310C. Monitor thread 311 retrieves the log message from input queues 310A, 310B or 310C, as represented by lines 307A, 307B, or 307C, respectively, and places the message on output log queue 312 via line 308. Another thread monitors the end of the output log queues and writes any message on the output log queues to an appropriate file, as represented by arrow 309.

Service-To-Service Communication

FIG. 4 is a block diagram illustrating the flow of information between services in the CPR system. FIG. 4 comprises the following elements: kernel router 401; queue and stream manager 124 managing queues 403A, 403B, 404A and 404B; remote service call manager 125; logging manager 121; storage manager 123 and database 414; application 410; network 411; and services 400A, 400B, 400C, 400D and 400E. All lines in FIG. 4 represent interaction between the respective components.

In FIG. 4, queue and stream manager 124 manages object queues 403A, 403B, 404A, and 404B, associated with media object communication between kernel router 401 and service 400A. Object queues 403A and 403B are coupled to kernel router 401 via lines 405A and 405B, respectively, and to service 400A via lines 406A and 406B, respectively. Object queues 404A and 404B are coupled to kernel router 401 via lines 407A and 407B, respectively, and to remote service call manager 125 via lines 408A and 408B, respectively.

Remote service call manager 125 is coupled to service 400A for the purpose of sending and receiving remote function calls derived from remote service call media objects via lines 409A and 409B. Service 400A is coupled to application 410 and network 411 via lines 412 and 413, respectively. Service 400A is also coupled to logging manager 121 and storage manager 123 via lines 415 and 416, respectively. Storage manager 123 is coupled to database 414. Services 400B, 400C, 400D and 400E are coupled to kernel router 401 via lines 402B, 402C, 402D and 402E, respectively.

Although not explicitly shown, services 400B-400E are coupled to kernel router 401 in a similar manner to which service 400A is coupled to kernel router 401, i.e. services 400B-400E are coupled via respective queues in queue and stream manager 124, and via remote service call manager 125 to kernel router 401.

If service 400A is an application service, then the service acts as the CPR interface for a third party application or device such as application 410. Information and requests from the third party application or device are thus transmitted via an application service into the CPR system in the form of media objects containing data or remote service calls. Also, media objects and remote service calls may be directed to service 400A to request services from the third party application or to return a service request response to the application.

If service 400A is a link service, then the link service provides an interface to other CPR nodes through a network connection or channel, as represented by network 411. Content, routing and kernel services interact directly with other services and components internal to the given CPR instance.

Service 400A interacts with logging manager 121 to log messages to a log file as previously described with respect to FIG. 3. Service 400A may interact with storage manager 123 to store and retrieve data to and from database 214.

Service 400A sends media objects to other services, such as service 400B, by placing a media object on queue 403B. Kernel router 401 retrieves the media object from queue 403B, reads the next destination (i.e., service 400B) from the object, and places it on similar queue bound to service 400B. Service 400B can similarly put a media object on a queue bound to kernel router 401, after which the kernel router 401 will retrieve the incoming media object and place it on queue 403A where it is retrieved by service 400A.

Media objects containing remote service calls originating from or destined for service 400A are passed between the kernel router and the remote service call manager via queues 404A and 404B. Alternatively, remote service call objects may be sent to the service via queue 403A, and forwarded from service 400A to the remote service call manager. Function calls and responses are passed between the remote service call manager and service 400A via lines 409A and 409B.

FIGS. 5A and 5B provide a more detailed description of the flow of remote service call objects. FIG. 5A shows the interaction between service 400A and kernel router 401 when service 400A is acting as a server with respect to a remote service call object. FIG. 5B illustrates the interaction between service 400A and kernel router 401 when service 400A is acting as a client with respect to a remote service call object. In this embodiment, remote service call manager 125 is equipped with a single outbound queue 404B directed to kernel router 401. No queue for passing objects from kernel router 401 to remote service call manager 125 is needed in this embodiment.

All media objects destined for service 400A, including remote service call objects, are passed to service queue 403A for transmission to service 400A. Those media objects which are remote service calls are detected by service 400A and forwarded to remote service call manager 125 for processing into a function call. Communication between service 400A and remote service call manager 125 is accomplished via stub code compiled into the service.

In FIG. 5A, with service 400A acting as a server, a remote service call object generated by a client service (not shown) is forwarded by kernel router 401 to service input queue 403A in step 1. In step 2, the media object is removed from input queue 403A by service 400A, and passed to remote service call manager 125. If remote service call manager 125 cannot process the object, it is returned to service 400A for post processing. If remote service call manager 125 recognizes the object as a remote service call, it unpackages the information from the remote service call and calls a stub function in service 400A in step 3.

When service 400A has actually performed the remote service call, service 400A returns any return values and status codes back to remote service call manager 125 in step 4. Remote service call manager 125 packages the function return values and status codes as a media object referencing the original call object, and, in step 5, places the new media object on queue 404B, which is bound to kernel router 401. In step 6, kernel router 401 obtains the returned media object from queue 404B and delivers it to the original client service that made the remote service call.

In FIG. 5B, service 400A acts as a client with respect to generating remote service calls. In step 1, service 400A calls stub code compiled into the service which in turn calls remote service call manager 125. In step 2, remote service call manager 125 packages the function call as a remote service call media object, and places the newly created object on queue 404B for kernel router 401. The object is removed from queue 404B in step 3, and kernel router 401 interacts with the service acting as a server as described with respect to FIG. 5A. Kernel router 401 may forward the remote service call object to a CBSR service for determination of an appropriate service to act as a server.

In step 4, kernel router 401 places the returned media object containing the response to the remote service call onto queue 403A. On receipt of the return function call object from queue 403A, in step 5, service 400A passes the object to remote service call 125. Remote service call manager 125 unpackages the returned call and correlates the call with the original call, signaling service 400A that the remote service call has completed in step 6. Service 400A then requests the returned parameters from the remote service call manager (again implemented in the same stub as step 1).

Node-To-Node Communications

FIG. 6 is a block diagram illustrating the process for communication between separate instances or nodes of the CPR system. Node A comprises services 602A, 603A and 604A coupled to kernel router 401A, and node B comprises services 602B, 603B and 604B coupled to kernel router 401B. Interaction between these services and the respective kernel routers is as described with respect to FIGS. 5A and 5B. Kernel router 401A is coupled to link service 600A via object queues 124A. Kernel router 401B is coupled to link service 600B via object queues 124B. Link service 600A and link service 600B are coupled to link manager 126A and link manager 126B, respectively. Link service 600A and link service 600B are coupled together via network 601, which acts as the communication link between node A and node B.

The process by which remote services communicate is described as follows with respect to the communication of a media object from service 602A of node A to service 602B of node B. In step 1, service 602A creates a media object addressed to remote service 602B and places the object on a queue bound to kernel router 401A. In step 2, kernel router 401A examines the address of the media object and determines, possibly with the assistance of the CBSR service, the best route to service 602B. In this case, the route found is through link service 600A. Therefore, the media object is placed on queue 124A bound to link service 600A.

On reception of the media object from queue 124A, in step 3, link service 600A interacts with li