Shopping assistance with handheld computing device

Abstract

A system is provided in which a handheld computing device may be used to provide a user with shopping assistance services. A shopping assistance service may allow a user to obtain directory information for a shopping mall. A user may use the handheld computing device to handle shopping lists. The handheld computing device may display promotional material based on the shopping lists. The handheld computing device may be used to obtain information on products being sold in a store. Products may be purchased using wireless financial transactions. Reminders and other messages may be sent to the handheld computing device. The location of the handheld computing device may be monitored. Services may be provided to the user based on the location of the handheld computing device. The handheld computing device may communicate with communications equipment in retail establishments using a local wireless link.

Claims

What is claimed is:

1. A method for providing a user at a handheld computing device with a shopping assistance service for an establishment having a plurality of stores, comprising:

allowing the handheld computing device to be used to establish a local wireless link with wireless communications equipment associated with the establishment;

displaying an on-screen option on the handheld computing device that allows the user to use the handheld computing device to obtain directory information identifying each of the plurality of stores over the local wireless link;

monitoring the user's location within the establishment; and

displaying promotional material on the handheld computing device based on the user's location.

2. The method defined in claim 1 further comprising using the handheld computing device to obtain mall directory information over a local wireless infrared link with the wireless communications equipment.

3. The method defined in claim 1 further comprising displaying a map showing the location of at least one of the stores within the establishment.

4. The method defined in claim 1 further comprising:

displaying store category information on the handheld computing device; and

displaying promotional information on the handheld computing device that is associated with at least one of the stores, wherein the store category information and the promotional information are displayed on a common screen by the handheld computing device.

5. A method for providing shopping assistance to a user with a handheld computing device in a store in an establishment having a plurality of stores, comprising:

using the handheld computing device in the store to establish a wireless link with a computer associated with the store;

displaying an on-screen option on the handheld computing device that provides the user with an opportunity to place a request for a product to be picked up and paid for in the store;

allowing the handheld computing device to be used to establish a local wireless link with wireless communications equipment associated with the establishment;

displaying an on-screen option on the handheld computing device that allows the user to use the handheld computing device to obtain directory information identifying each of the plurality of stores over the local wireless link;

monitoring the user's location within the establishment; and

displaying promotional material on the handheld computing device based on the user's location.

6. The method defined in claim 5 wherein the on-screen option allows the user to place a request for deli products at a deli within the store.

7. The method defined in claim 5 further comprising displaying information on the handheld computing device on the locations within the store of various products offered for sale in the store.

8. The method defined in claim 5 further comprising:

using a local radio-frequency wireless link to communicate between the handheld computing device and the computer associated with the store; and

displaying promotional information related to products offered for sale in the store on the handheld computing device.

9. The method defined in claim 5 further comprising:

displaying an interactive advertisement related to a product offered for sale in the store on the handheld computing device; and

providing the user with a financial benefit at checkout if the user responds to the interactive advertisement.

10. The method defined in claim 5 further comprising transmitting an electronic message to the handheld computing device when the requested product is ready to be picked up.

11. A method for using a mobile electronic device to provide shopping assistance to a customer who is shopping in a retail store in an establishment having a plurality of stores, comprising:

using the mobile electronic device to establish a wireless link with a computer;

using the mobile electronic device in the retail store to display an on-screen option that allows the customer to obtain information from the computer on where products are located in the store;

allowing the handheld computing device to be used to establish a local wireless link with wireless communications equipment associated with the establishment;

displaying an on-screen option on the handheld computing device that allows the user to use the handheld computing device to obtain directory information identifying each of the plurality of stores over the local wireless link;

monitoring the user's location within the establishment; and

displaying promotional material on the handheld computing device based on the user's location.

12. The method defined in claim 11 further comprising displaying promotional material to the user with the mobile electronic device.

13. The method defined in claim 11 further comprising using the mobile electronic device to display an on-screen option that allows the user to search for products within the store using the computer.

14. The method defined in claim 11 wherein the mobile electronic device is a handheld computer, the method further comprising:

allowing the user to use the handheld computer to input a product name; and

displaying information on the product from the computer based on the product name; and

displaying interactive advertisements for products in the store on the handheld computer.

15. The method defined in claim 11 further comprising:

using the mobile electronic device to wirelessly identify a product in the store; and

adding the identified product to a list with the mobile electronic device.

16. The method defined in claim 11 further comprising using the mobile electronic device to display a video to the user in the store.

17. The method defined in claim 11 further comprising:

allowing the user to create a shopping list using an in-home electronic device; and

using the mobile electronic device to access the shopping list in the store.

18. A method for providing shopping assistance to a user in a store with a mobile electronic device in an establishment having a plurality of stores, comprising:

using the mobile electronic device to establish a local wireless link with a computer;

displaying a screen on the mobile electronic device that contains promotional information from the computer on products offered for sale in the store;

allowing the handheld computing device to be used to establish a local wireless link with wireless communications equipment associated with the establishment;

displaying an on-screen option on the handheld computing device that allows the user to use the handheld computing device to obtain directory information identifying each of the plurality of stores over the local wireless link;

monitoring the user's location within the establishment; and

displaying promotional material on the handheld computing device based on the user's location.

19. The method defined in claim 18 wherein the mobile electronic device is a handheld computer, the method further comprising using the handheld computer to provide the user with an opportunity to order products over a remote wireless link.

20. The method defined in claim 18 wherein the promotional information is an interactive offer related to a product in the store, the method further comprising:

allowing the user to accept the offer using the mobile electronic device; and

providing the user with a financial benefit related to the offer at checkout.

21. The method defined in claim 18 further comprising:

monitoring the user's location within the store; and

using the mobile electronic device to display information to the user based on the user's location within the store.

Description

BACKGROUND OF THE INVENTION

This invention relates to systems based on handheld computing devices, and more particularly, to systems based on handheld computing devices that assist users in shopping and in performing wireless transactions.

Computer systems have been developed that allow users to shop on-line for a variety of products. For example, users may order groceries over the Internet. Users may also obtain product information using the Internet and may obtain information on retail establishments. For example, users may use the Internet to obtain store hours and general information about a store. A web site for a shopping mall may allow the user to obtain information about a particular store in the mall.

When the user travels to a store or other shopping establishment, the user's options are limited. Shopping malls have printed directories and maps that the user may consult to locate stores of interest. Product brochures may sometimes be obtained from store personnel. A user with a cellular phone may be able to call a store for information such as the store's hours.

In some supermarkets, users may use a kiosk to place a deli order. Department stores may have kiosks that allow users to obtain access to gift registry information for customers who have registered with the department store.

Although handheld computers have been developed that allow users to keep track of appointments, play games, record voice memos, and obtain certain limited information from the Internet, such devices have not generally been able to assist the user in shopping and in performing wireless transactions.

It is an object of the present invention to provide improved systems based on handheld computing devices for assisting users in shopping and wireless transactions.

SUMMARY OF THE INVENTION

A system is provided that allows users with handheld computing devices to obtain information using local and remote wireless links. Handheld computing devices may also be used to order products and services.

A shopping assistance service may be used that provides users with handheld computing devices access to directory information. The service may also provide product information. Interactive advertisements may be provided.

The system may support electronic shopping techniques in which users make financial commitments toward purchases prior to completing purchase transactions.

The handheld computing device may have an expansion slot that accepts accessories such as local wireless communications accessories. Accessories may include a bar code scanner, a radio-frequency identification (RFID) unit, a smart card attachment, etc. These attachments may be integrated into the handheld computing device if desired.

The handheld computing device may be used in financial transactions. For example, the handheld computing device may be used to wirelessly pay for products in stores. Expense reports may be automatically created using information on such wireless purchase transactions. If desired, the smart card features of a smart card attachment or accessory may be used during these transactions.

The handheld computing device may also be used for communications functions such as sending and receiving e-mail. Wireless communications may involve short-range or local wireless links and may also involve longer-range or remote wireless links.

If desired, a user may use the handheld computing device to exchange virtual business cards or other personal information with other handheld computing devices.

The handheld computing device may be used for electronic ticket applications. For example, the handheld computing device may be used to replace paper tickets on trains or other forms of transportation, in amusement parks, etc.

The handheld computing device may communicate with a merchant over a wireless communications link. For example, the handheld computing device may communicate with the merchant over a remote wireless link.

If desired, the handheld computing device may communicate with merchants and other entities by forming a local wireless link. A local wireless transmitter/receiver may be used to communicate with the handheld computing device. The local wireless transmitter/receiver may be connected to a communications network such as the Internet. Such a local wireless transmitter/receiver may serve as a local access point to the Internet or other such communications network for the handheld computing device. The handheld computing device may communicate with remote service provider servers and other computers over the communications network through the local access point.

The coverage of a number of local wireless transmitter/receivers may be arranged to overlap to form a wireless local area network. The location of the user may be determined by determining which local wireless transmitter/receiver the handheld computing device is in communication with. The location of the user may also be determined by using a GPS receiver associated with the handheld computing device or by using network-based techniques such as triangulation and time-of-flight measurements when the user is in communication with an appropriate wireless network.

The handheld computing device may use a bar code scanner or radio-frequency identification (RFID) circuitry to identify items in stores. Categories of products and manufacturers may also be identified. Shopping lists may be created based on products that are identified. The user's current shopping list may be displayed and modified using in-home equipment, an automobile personal computer, a handheld computing device, or in-store equipment.

The handheld computing device may display price comparison information for the user while the user is in a store. Product information may also be displayed by the handheld computing device when the user is in the store. Product information from multiple manufacturers may be obtained. If desired, product information may be organized in various product-categories. The handheld computing device may allow the user to search for information on products and manufacturers of interest while the user is in the store. The handheld computing device may display product information screens with interactive features.

The user may be alerted when a shopping assistance service is available. The shopping assistance service may then be used to obtain shopping information. A shopping mall shopping assistance service may be provided. The shopping mall shopping assistance service may provide information on current events. A general information screen may be provided. If desired, the shopping assistance service may provide directory information. Maps and directions may be provided.

The shopping assistance service may display information on specials. The user may search for desired products, services, and stores at the mall. Various types of messages may be provided to the handheld computing device. For example, a proximity message may be provided. The user may be alerted when a message is received from a nearby merchant. The user may also be alerted to the availability of a special. Messages regarding specials may include interactive features. Messages may be provided to the user to notify the user or to remind the user of certain events. The user may adjust alert settings for various message types.

The user may track the location and use of the handheld computing device. For example, the user may track the financial transactions that are made with the handheld computing device. The user may also establish restrictions on the financial transactions that may be made with the handheld computing device.

A supermarket shopping assistance service may be used to display information on products available in a supermarket. Targeted specials and other advertising and promotional material may be displayed on the handheld computing device. Such promotional material may be displayed in combination with shopping list information. The promotional material that is displayed may be targeted based on the contents of the shopping list. For example, if a shopping list includes a particular dessert item, logos and advertisements for dessert-related products may be displayed.

A supermarket shopping assistance service may provide a search screen for searching for products. Menu ideas may be provided. Ingredients from recipes provided by the supermarket shopping assistance service may be added to the user's shopping list.

If desired, location-based shopping services may be provided. For example, location-based advertisements may be displayed on the handheld computing device. Manufacturers may provide discounts and other financial benefits to supermarket customers using handheld computing devices.

The supermarket shopping assistance service may also be used to place orders for products. The products may be delivered to the user from an order fulfillment facility or may be picked up by the user in the supermarket. As an example, the user may use the handheld computing device to place a deli order to be picked up in the store. The order may be place over a local or remote wireless link. The deli may send a notification to the user over the remote or local wireless link when the order is ready to be picked up. This arrangement may also be used in other retail environments. For example, orders may be placed and notifications sent at shopping malls, department stores, airports, etc.

A department store shopping assistance service may be provided using the handheld computing device. A directory screen may be displayed by such a department store shopping assistance service. The service may allow a user to use a handheld computing device to request sales assistance. The handheld computing device may be used to provide access to a gift registry service.

If desired, a shopping list may be created based on video content. The video content may be displayed on in-home electronic equipment or the handheld computing device. The user may order ingredients associated with the video or may add ingredients associated with the video to the user's shopping list.

The handheld computing device may interact with kiosks. For example, audio files containing music or the like may be downloaded to handheld computing device from an audio kiosk. Images and video content may also be downloaded from a kiosk. The user may arrange for home delivery of audio and video content from a kiosk if desired.

The handheld computing device may be used in an automobile for financial transactions such as purchasing gasoline, paying tolls, paying for parking, purchasing food from drive-through restaurants, etc. Records may be maintained of these transactions and expense reports automatically generated based on the records.

Further features of the invention, its nature and various advantages will be more apparent from the accompanying drawings and the following detailed description of the preferred embodiments.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of an illustrative system in accordance with the present invention.

FIG. 2 is a diagram showing further aspects of an illustrative system in accordance with the present invention.

FIG. 3 is a flow chart of illustrative steps involved in electronic shopping techniques in which a user makes a financial commitment toward a purchase in accordance with the present invention.

FIG. 4 is a schematic diagram of an illustrative handheld computing device in accordance with the present invention.

FIG. 5 is a front view of an illustrative handheld computing device in accordance with the present invention.

FIG. 6 is a schematic diagram of an illustrative handheld computing device in accordance with the present invention.

FIG. 7 is a flow chart of illustrative steps involved in financial transaction and communications functions involving the handheld computing device in accordance with the present invention.

FIG. 8 shows an illustrative screen that may be used in exchanging virtual business cards in accordance with the present invention.

FIG. 9 shows another illustrative screen that may be used in exchanging virtual business cards in accordance with the present invention.

FIG. 10 is a flow chart of illustrative steps involved in using handheld computing device in wireless financial transactions in accordance with the present invention.

FIG. 11 shows an illustrative screen that may be used in providing an expense report based on wireless financial transactions in accordance with the present invention.

FIG. 12 is a flow chart of illustrative steps involved in using a handheld computing device for electronic ticket applications in accordance with the present invention.

FIG. 13 is a schematic diagram showing how a handheld computing device may establish a wireless communications link with a merchant in accordance with the present invention.

FIG. 14 is a schematic diagram of a system arrangement involving multiple merchants and other parties and equipment in accordance with the present invention.

FIG. 15 is a schematic diagram of a system that includes multiple local wireless transmitter/receivers in accordance with the present invention.

FIG. 16 is a top view of a corridor with multiple merchants showing the coverage of illustrative local wireless transmitter/receivers in accordance with the present invention.

FIG. 17 is a top view of a store showing the wireless coverage provided by multiple wireless transmitter/receivers in accordance with the present invention.

FIG. 18 is a diagram showing how global positioning system satellites may be used to determine the location of a handheld computing device in accordance with the present invention.

FIG. 19 is a schematic diagram of a system arrangement in which multiple handheld computing devices communicate with a service provider through common wireless communication equipment in accordance with the present invention.

FIG. 20 is a flow chart of illustrative steps involved in using a handheld computing device to communicate with a remote service provider using a local wireless communications link in accordance with the present invention.

FIG. 21 is a schematic diagram of a system arrangement in which a handheld computing device with a bar code scanner may be used to create shopping lists in accordance with the present invention.

FIG. 22 shows an illustrative screen that may be displayed to provide the user with information on an item that has been scanned in accordance with the present invention.

FIG. 23 shows an illustrative screen that may be displayed by a handheld computing device to show information on the user's shopping list in accordance with the present invention.

FIG. 24 shows an illustrative screen that shows how information on the user's current shopping list may be displayed with in-home equipment in accordance with the present invention.

FIG. 25 is a flow chart of illustrative steps involved in ordering products that are identified in a store using a handheld computing device in accordance with the present invention.

FIG. 26 is a flow chart of illustrative steps involved in using a handheld computing device or other equipment to identify products, categories of products, and manufacturers in accordance with the present invention.

FIG. 27 shows an illustrative screen showing information that may be provided when an in-store product is scanned in accordance with the present invention.

FIG. 28 shows an illustrative screen showing price comparison information that may be provided using a handheld computing device in accordance with the present invention.

FIG. 29 shows an illustrative screen showing how product information may be accessed using a handheld computing device in accordance with the present invention.

FIG. 30 shows an illustrative screen that may be used to provide access to product information from multiple manufacturers in accordance with the present invention.

FIG. 31 shows an illustrative screen that may be displayed to provide access to product information organized in various product categories in accordance with the present invention.

FIG. 32 shows an illustrative product information search results screen that may be displayed in accordance with the present invention.

FIG. 33 shows an illustrative product information screen that may be displayed in accordance with the present invention.

FIG. 34 shows an illustrative product information screen with interactive features that may be displayed in accordance with the present invention.

FIG. 35 is a flow chart of illustrative steps involved in alerting a user when a shopping assistance service is available in accordance with the present invention.

FIG. 36 is a flow chart of illustrative steps involved in using a shopping assistance service to obtain shopping information in accordance with the present invention.

FIG. 37 shows an illustrative main menu screen that a shopping mall shopping assistance service may display in accordance with the present invention.

FIG. 38 shows an illustrative screen of current events that a shopping assistance service may display in accordance with the present invention.

FIG. 39 shows an illustrative general information screen that a shopping assistance service may display in accordance with the present invention.

FIG. 40 shows an illustrative directory screen that a shopping assistance service may display in accordance with the present invention.

FIG. 41 shows an illustrative screen of directory information that a shopping assistance service may display in accordance with the present invention.

FIG. 42 shows an illustrative map screen that a shopping assistance service may display in accordance with the present invention.

FIG. 43 shows an illustrative screen of directions that a shopping assistance service may display in accordance with the present invention.

FIG. 44 shows an illustrative information screen for a store in a mall that a shopping assistance service may display in accordance with the present invention.

FIG. 45 shows an illustrative map screen with directions that a shopping assistance service may display in accordance with the present invention.

FIG. 46 shows an illustrative screen of specials that a shopping assistance service may display in accordance with the present invention.

FIG. 47 shows an illustrative search screen that a shopping assistance service may display in accordance with the present invention.

FIG. 48 is a flow chart of illustrative steps involved in using a shopping assistance service to search for desired products, services, and stores in accordance with the present invention.

FIG. 49 is a flow chart of illustrative steps involved in providing messages to a handheld computing device in accordance with the present invention.

FIG. 50 shows an illustrative screen that may be used to present various different types of message information to the user in accordance with the present invention.

FIG. 51 shows a screen containing an illustrative proximity message in accordance with the present invention.

FIG. 52 shows a screen containing another illustrative proximity message in accordance with the present invention.

FIG. 53 is a flow chart of illustrative steps involved in alerting a user to a message from a nearby merchant in accordance with the present invention.

FIG. 54 is a flow chart of illustrative steps involved in alerting a user to a special in accordance with the present invention.

FIG. 55 shows a screen containing an illustrative passive special that may be provided in accordance with the present invention.

FIG. 56 shows a screen containing an illustrative interactive special that may be provided in accordance with the present invention.

FIG. 57 shows a screen that may be displayed when a user responds to an interactive special of the type shown in FIG. 56.

FIG. 58 is a flow chart of illustrative steps involved in providing specials in accordance with the present invention.

FIG. 59 shows an illustrative confirmation screen for a special that may be displayed in accordance with the present invention.

FIG. 60 shows a screen containing an illustrative notification that may be displayed in accordance with the present invention.

FIG. 61 shows a screen containing another illustrative notification that may be displayed in accordance with the present invention.

FIG. 62 shows a screen containing another illustrative notification that may be displayed in accordance with the present invention.

FIG. 63 is a flow chart of illustrative steps involved in providing notifications in accordance with the present invention.

FIG. 64 shows a screen containing an illustrative reminder that may be displayed in accordance with the present invention.

FIG. 65 shows a screen containing another illustrative reminder that may be displayed in accordance with the present invention.

FIG. 66 shows a screen containing another illustrative reminder that may be displayed in accordance with the present invention.

FIG. 67 is a flow chart of illustrative steps involved in providing reminders in accordance with the present invention.

FIG. 68 is a flow chart of illustrative steps involved in providing reminders using local and remote communications paths in accordance with the present invention.

FIG. 69 shows an illustrative screen that may be displayed to provide the user with an opportunity to adjust alert settings for various message types in accordance with the present invention.

FIG. 70 shows an illustrative screen that may be displayed to show information on filter criteria in accordance with the present invention.

FIG. 71 is a flow chart of illustrative steps involved in providing notifications to the user based on various events in accordance with the present invention.

FIG. 72 shows an illustrative screen that may be displayed for the user when the user desires to track the location and use of a handheld computing device in accordance with the present invention.

FIG. 73 is a flow chart of illustrative steps involved in monitoring the location of a handheld computing device in accordance with the present invention.

FIG. 74 is a flow chart of illustrative steps involved in monitoring financial transactions made with a handheld computing device in accordance with the present invention.

FIG. 75 shows an illustrative screen that may be displayed for the user when the user is setting up restrictions for financial transactions with a handheld computing device in accordance with the present invention.

FIG. 76 shows an illustrative screen that may be displayed for the user when the user is controlling the financial transactions of a handheld computing device in accordance with the present invention.

FIG. 77 is a flow chart of illustrative steps involved in restricting financial transactions made with a handheld computing device in accordance with the present invention.

FIG. 78 shows an illustrative screen containing a targeted special in accordance with the present invention.

FIG. 79 is a flow chart of illustrative steps involved in displaying targeted advertising with a handheld computing device in accordance with the present invention.

FIG. 80 shows an illustrative screen containing a shopping list in accordance with the present invention.

FIG. 81 is a flow chart of illustrative steps involved in creating a shopping list in accordance with the present invention.

FIG. 82 shows an illustrative screen containing a main menu for a supermarket shopping assistance service in accordance with the present invention.

FIG. 83 shows an illustrative directory screen for a shopping assistance service in accordance with the present invention.

FIG. 84 shows an illustrative screen containing promotional information for a product that may be displayed by a shopping assistance service in accordance with the present invention.

FIG. 85 shows an illustrative search screen for a shopping assistance service in accordance with the present invention.

FIG. 86 shows an illustrative search results screen for a shopping assistance service in accordance with the present invention.

FIG. 87 shows an illustrative screen for a special that a shopping assistance service may display in accordance with the present invention.

FIG. 88 shows another illustrative screen for a special that a shopping assistance service may display in accordance with the present invention.

FIG. 89 shows a screen containing an illustrative shopping list in accordance with the present invention.

FIG. 90 shows a screen containing another illustrative shopping list in accordance with the present invention.

FIG. 91 shows an illustrative screen of menu ideas that may be displayed in accordance with the present invention.

FIG. 92 shows an illustrative screen containing a list of ingredients for a recipe in accordance with the present invention.

FIG. 93 is a flow chart of illustrative steps involved in displaying information with a shopping assistance service in accordance with the present invention.

FIG. 94 shows a screen containing an illustrative location-based shopping list in accordance with the present invention.

FIG. 95 shows a screen containing an illustrative advertisement in accordance with the present invention.

FIG. 96 is a flow chart of illustrative steps involved in displaying location-based advertisements in accordance with the present invention.

FIG. 97 is a flow chart of illustrative steps involved in using a shopping list in accordance with the present invention.

FIG. 98 is a flow chart of illustrative steps involved in allowing manufacturers to provide financial benefits in accordance with the present invention.

FIG. 99 is a flow chart of illustrative steps involved in ensuring that entitled customers receive discounts in accordance with the present invention.

FIG. 100 shows a screen containing an illustrative main menu that may be displayed by a department store shopping assistance service in accordance with the present invention.

FIG. 101 shows an illustrative directory screen that may be displayed by a shopping assistance service in accordance with the present invention.

FIG. 102 shows an illustrative confirmation screen that may be displayed by a shopping assistance service when the user requests sales assistance in accordance with the present invention.

FIG. 103 shows an illustrative gift registry search screen that may be displayed by a shopping assistance service in accordance with the present invention.

FIG. 104 shows an illustrative gift registry search results screen that may be displayed by a shopping assistance service in accordance with the present invention.

FIG. 105 is a flow chart of illustrative steps involved in creating a shopping list based on video content in accordance with the present invention.

FIG. 106 shows an illustrative screen containing video and on-screen options that allow the user to order ingredients associated with the video or to add ingredients associated with the video to the user's shopping list in accordance with the present invention.

FIG. 107 is a schematic diagram of an illustrative kiosk system in accordance with the present invention.

FIG. 108 shows an illustrative screen that an audio kiosk may display in accordance with the present invention.

FIG. 109 shows another illustrative screen that an audio kiosk may display in accordance with the present invention.

FIG. 110 is a flow chart of illustrative steps involved in using an audio kiosk in accordance with the present invention.

FIG. 111 is a schematic diagram of an illustrative kiosk system having control and content facilities in accordance with the present invention.

FIG. 112 is a flow chart of illustrative steps involved in using a kiosk to provide virtual postcards to a handheld computing device in accordance with the present invention.

FIG. 113 shows an illustrative screen that may be displayed to provide the user with an opportunity to place an order at a supermarket deli using the handheld computing device in accordance with the present invention.

FIG. 114 shows an illustrative screen that may be displayed by a computer at a deli counter to convey the user's order to deli personnel in accordance with the present invention.

FIG. 115 is a flow chart of illustrative steps involved in allowing users to use handheld computing devices to place orders at stores that are to be picked up in accordance with the present invention.

FIG. 116 is a schematic diagram showing how the handheld computing device may be used in an automobile for wireless purchase transactions in accordance with the present invention.

FIG. 117 is a flow chart of illustrative steps involved in using the handheld computing device in an automobile in accordance with the present invention.

FIG. 118 shows an illustrative screen that the handheld computing device may display following a wireless transaction performed from within an automobile in accordance with the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

An illustrative electronic commerce system 10 is shown in FIG. 1. Handheld computing device 12 may interact with various entities using wireless and wired communications. Handheld computing device 12 may be a handheld computer or any other suitable handheld computing device. As an example, a cellular telephone with computing capabilities may be used to perform some of the functions of handheld computing device 12. For many functions, handheld computers may be preferable to cellular telephones. Handheld computers generally have larger screens than cellular telephones and have superior computing capabilities. Handheld computers may also more readily accept attachments that allow their capabilities to be extended. Handheld computers and handheld computing devices are examples of mobile electronic devices. In some instances, mobile electronic devices such as shopping-cart-mounted electronic devices or the like may be used to perform the functions of handheld computing devices such as handheld computers or the like. The features of the present invention are described primarily in connection with handheld computing devices for clarity.

Handheld computing device 12 may be used to interact with restaurant 14, department store 16, shopping mall 18, supermarket 20, and other merchants such as merchant 22. Handheld computing device 12 may be used to place orders and to obtain information on the products and services offered by such merchants. Handheld computing device 12 may also be used to display promotional materials provided by these merchants. A service provider such as service provider 24 may be used to provide information, process orders, etc. Service provider 24 may be associated with one or more merchants or may operate independently.

Handheld computing device 12 may be used to obtain information and products and services from kiosks such as kiosk 26. Handheld computing device 12 may also be used to obtain information and products and services from other such devices such as vending machines, jukeboxes, etc.

In-home electronic device 28 may be used in requesting information, creating shopping lists, and placing orders for products and services. For example, in-home electronic device 28 may also be used to generate a grocery list of items to be picked up by the user in a brick-and-mortar store. The shopping list may be transmitted from the in-home electronic device to handheld computing device 12 for use in assisting the user when shopping in the store.

If desired, handheld computing device 12 may be used in an automobile. Handheld computing device 12 may be used to pay for gasoline at gas stations such as gas station 30. Handheld computing device 12 may also be used to pay for tolls and parking by interacting with toll collection facilities and parking facilities. In addition, food may be purchased from drive-through restaurants using handheld computing device 12. Handheld computing device 12 may also be used to interact with various other entities and facilities 32.

An illustrative arrangement in which in-home electronic device 28 may be used to request information and place orders is shown in FIG. 2. In-home electronic device 28 may be any suitable in-home electronic device or appliance, such as a personal computer, a web appliance, a refrigerator-mounted computing device, a countertop electronic device, a dedicated information and control appliance, a residential gateway device, a security system controller, a peripheral or client device or other such device that is that is connected to a residential gateway, personal computer, security system controller, or other in-home computer or electronic device. As an example, in-home electronic device 28 may be a computing device located in the user's kitchen.

The user may enter grocery items into device 28 to create a grocery order. The order may be transmitted to an order fulfillment facility such as order fulfillment facility over communications network 32. This type of order may be placed using a web interface. Order fulfillment facility 30 may support a web-based grocery delivery service. The communications network 32 may included the Internet. The user may access the grocery delivery service over the Internet using a web browser or the like. Orders may be created while the user is on-line with the grocery ordering service or may be created off-line and transmitted to the grocery ordering service later. Such orders may, for example, be transmitted at periodic intervals, when requested by the grocery delivery service or in-home electronic device, when desired by the user, continuously, or using a combination of such transmission arrangements or any other suitable arrangement.

Grocery items are merely an illustrative example of the type of products that may be ordered using in-home electronic device. In-home electronic device 28 may be used to create on-line orders for any suitable products and services if desired. For example, in-home electronic device may be used to create orders for department store items, electronics, appliances, gifts, etc.

The user may also use in-home electronic device 28 to create shopping lists. For example, family members in the user's household may occasionally think of grocery items or other items that need to be purchased. These items may be added to a shopping list using in-home electronic device 28. The information from the shopping list may be provided to the user when shopping in a store, mall, or other establishment 34. As an example, the shopping list information may be provided to a kiosk or other retailer equipment 36 that includes a computer 38. A user may print out the list from the kiosk.

The user may also access the shopping list by downloading the shopping list in the store or other establishment. The shopping list may be downloaded using a physical connection or a wireless communications path.

Shopping lists and orders for products and services may also be created using devices other than in-home electronic device 28. For example, lists and orders may be handled using a handheld computing device 12 that is in communication with communications network 32 over a wireless or wired communications link 40. A personal computer at the office or other suitable computer 42 may be used by the user or other parties to create shopping lists and orders for products and services. If desired, an automobile personal computer 44 may be used to generate shopping lists and orders for products and services.

Platforms such as in-home electronic device 28, handheld computing device 12, computer 42, and automobile personal computer 44 may support remote interactions with stores, malls, and other establishments and with one or more service providers 46. Service providers may be used to provide shopping assistance services for in-store shoppers. Service providers may also be used to supply content to various platforms. Services such as product and service ordering may be supported by service providers. In addition, shopping list services may be supported by service providers.

As an example, a shopping list creation service that is supported by a service provider may allow a user to add items to a shopping list maintained at a remote server (e.g., a server located at service provider 46 or associated with service provider 46). When the user is shopping in a store or other establishment 34, the user may access the shopping list from service provider 46.

If desired, service provider 46 may support multiple services. For example, service provider 46 may support a product ordering service (e.g., on-line grocery deliveries or grocery orders processed for in-store pickup) and a shopping assistance service (e.g., a shopping list service or the like).

Service provider 46 may communicate with manufacturers such as manufacturer 48. Manufacturers may offer coupons, discounts, or other benefits to users. It may or may not be readily apparent to the user that the manufacturer is providing a benefit. For example, a service provider may provide a user with an opportunity to make a financial commitment towards making a shopping purchase. The user may, for example, select a certain grocery item that the user desires to purchase. The user may offer to pay a certain price for the item or may make another suitable financial commitment toward purchasing the item. A given manufacturer may subsidize the user's purchase by offering a discount provided that the user purchases the item from that given manufacturer. Such discounts may be provided by the service provider, the store, mall, or other establishment, or any other suitable entity.

Information may be delivered to platforms such as in-home electronic device 28, handheld computing device 12, automobile personal computer 44, and computer 42. For example, the user may request a media file while shopping. The user's request may be passed to a service provider that may deliver the requested file to in-home electronic device 28, handheld computing device 12, automobile personal computer 44, or computer 42. As an example, a recipe video may be delivered in this way.

Services may be provided using applications that are implemented locally on platforms such as in-home electronic device 28, handheld computing device 12, automobile personal computer 44, and computer 42. For example, a recipe service that assists the user in selecting menu items for dinner may be implemented using a locally-executed application.

Services may also be provided using remote applications. For example, the recipe service may be implemented using a remote server connected to communications network 32 (e.g., a remote server located at or associated with service provider 46). The user may use a platform such as in-home electronic device 28, handheld computing device 12, automobile personal computer 44, or computer 42 to access the remote server. A web browser or other suitable browser application such as a microbrowser may be used to access the remote server.

Remote applications and services may be desirable when providing centralized access to certain information. For example, a shopping list service that is based on a remote server may be accessed from various platforms, whereas a shopping list service that is run using a local application may only be used where that local application has been implemented or when the local application may be accessed by other devices.

Services that are accessed remotely may use client-server or distributed computing arrangements. Remotely implemented services may also interact with locally-executed applications. In general, services may be provided using local arrangements, remote arrangements, or arrangements that use a combination of local and remote arrangements. The applications that individually or collectively support the features of such services are generally referred to herein as "applications" or "services" regardless of the nature of the platform or platforms on which they are implemented.

The components of FIGS. 1 and 2 may be interconnected using any suitable wired or wireless communications paths. Analog and digital transmissions may be involved. Communications paths may use the Internet. Packet-based arrangements may be used. Wired paths may use cable or other wires or fiber optics. Wireless paths may use optical or radio-frequency communications. Certain types of communications favor wireless paths. For example, handheld computing device 12 and automobile personal computer 44 of FIG. 2 typically communicate with the components of FIG. 2 via wireless paths such as paths 40, 48, and 52, because handheld computing device 12 and automobile personal computer 44 are mobile devices. If desired, however, handheld computing device 12 or automobile personal computer may be connected to various components in system 10 using wired paths. In the arrangement of FIG. 2, communications paths such as paths 50 and 52 are typically wireless paths. Paths such as paths 40 and 54 may be wired or wireless paths. The paths 56 that are illustrated in FIG. 1 may be wired or wireless, but typically involve at least some wireless communications.

Wireless communications paths may use infrared (IR) communications. For example, an infrared transmitter/receiver may be provided in retailer equipment 36. An IR communications link may be formed between retailer equipment 36 and handheld computing device 12 using an IR transmitter/receiver in handheld computing device 12.

Wireless radio-frequency (RF) communications may use any suitable radio frequencies. For example, frequencies such as 900 MHz or 2.4 GHz or other ultra-high frequencies (UHF) may be used. These are merely illustrative examples. Any suitable frequency or frequencies may be used for wireless RF transmissions.

Wireless communications paths that use short-range optical connections such as IR links and short-range RF links over distances from a fraction of a foot to hundreds of feet are referred to herein as "local" communications paths or links. An example of a local communications path is an IR link between handheld computing device 12 and a kiosk or cash register. Another example of a local communications path is a Bluetooth connection between handheld computing device 12 and a wireless transmitter/receiver associated with a store, merchant, mall, or other establishment or entity. Such a connection may operate at 2.4 GHz. Another example of a local communications path is a wireless path between handheld computing device 12 and a wireless local area network. Such a wireless local area network may act as a local access point to a larger communications network such as the Internet.

Wireless communications paths over longer distances (e.g., fractions of miles or more) are referred to herein as "remote" communications paths or links. Examples of remote communications paths include cellular telephone links to terrestrial cellular base stations, satellite links (e.g., to communications satellites that provide Internet access, wireless telephone services, or data services or the like), links to FM data services that are distributed from terrestrial broadcast stations, etc.

Illustrative steps involved in providing a shopping list service are shown in FIG. 3. At step 58, a shopping list application is used to provide a user at a user device such as an in-home electronic device 28, handheld computing device 12, automobile personal computer 44, and computer 42 with an opportunity to create a shopping list. For example, an in-home electronic device such as a refrigerator-mounted or countertop electronic appliance may be used to display interactive options to the user that allow the user to select shopping list items from an on-screen list of possible items or to enter shopping list items.

If desired, the process of booting up a full-fledged personal computer may be avoided by using an in-home electronic device that is less complex than a traditional personal computer. Such an in-home electronic device may, for example, be in an always-on or nearly always-on state. The operating system may be less complex than a traditional personal computer operating system. Only a limited number of applications may be supported by the device. The in-home electronic device may also use a touch screen. The in-home electronic device may use a tablet or flat-panel design. Such devices may be mounted on the front of a refrigerator or a kitchen cabinet or on the wall. The in-home electronic device may be battery powered or may use DC power supplied from a wall-mounted AC-to-DC power supply. These are merely illustrative examples of the types of arrangements that may be used to make the in-home electronic device more accessible than a traditional personal computer. If desired, however, a traditional personal computer in the home may be used to enter the shopping list items at step 58.

Other individuals such as other family members may add to the shopping list at step 58. For example, a family member may add to the list from the office using an office computer connected to the Internet. Another family member may add to the list using an automobile personal computer. The list may be generated by allowing each contributor to the list to access a central shopping list file. Such a file may be maintained, for example, on a server associated with a service provider. The list may also be generated by allowing each contributor to create lists locally. Such locally-generated lists may be combined locally or at a remote location (e.g., at a service provider or a merchant, etc.).

Shopping list information may be provided to a service provider or merchant at suitable predefined intervals (e.g., once every 10 minutes, once per day, etc.). Information for the list may also be provided to a service provider or merchant a certain period of time after each time the list is last modified (e.g., 10 minutes after each time the list is last modified). List information may also be provided to the service provider when requested by the service provider or the user. The service provider may store the information until requested by the user (e.g., when shopping) or may provide the information to the store or other establishment in advance for local retrieval by the user when shopping. A combination of these approaches or any other suitable approach may be used if desired. These are merely illustrative examples, any suitable arrangement may be used to provide the user and other parties with an opportunity to create shopping lists at step 58.

If desired, the user may designate certain items for home delivery. In this capacity, the shopping list service serves as an on-line merchant. Other shopping list information may be used to assist the user in locating products of interest during in-store shopping.

Regardless of whether the shopping list items are ordered on-line, are used for an order to be picked up by the user at a merchant, or are used to assist the user during in-store shopping, the user and other parties may be provided with an opportunity to make a financial commitment towards the purchase of a product or service at step 60. The financial commitment may be, for example, an agreement by the user that the user's credit card account or other financial account will be charged if suitable products are found matching the user's requests.

Manufacturers, stores, and other entities may respond to such a financial commitment by providing the user with a discount or other financial benefit or the like at step 62. Such benefits may be provided, for example, in the form of an electronic discount on the purchase price for an item that is awarded during the purchase transaction at step 62. The user may also be provided with a benefit by having multiple sellers compete against one another for the lowest selling price. A computer associated with the service provider may match the user to the seller with the lowest price. During shopping, information may be displayed to the user with a handheld computing device or the like based on which items are in the user's shopping list.

Illustrative components of handheld computing device 12 are shown in FIG. 4. Handheld computing device 12 may contain a processor circuitry 64 that is based on a microprocessor or microcontroller 66, a digital signal processor 68, and other processing and control circuitry 70.

Storage 72 may include random-access memory (RAM) 74, read-only memory (ROM), and any other suitable volatile or non-volatile memory or storage device 78.

Display 80 may include a liquid-crystal display (LCD) 82, a touch screen 84, or any other suitable display screens 86. Display 80 may be color or monochrome and may be front-lit or back-lit. An active matrix design may be used if desired.

Communications and I/O 88 may include keys or other input interface devices 90 such as a touch pad, track ball, or other pointing device, a keypad a keyboard, dedicated buttons, etc. Small keys or buttons may be used to ensure that handheld computing device is relatively small and lightweight. A port 92 may be used to connect handheld computing device 12 to an external computer or other electronic device. Port 92 may be any suitable port or ports, such as a FireWire port (IEEE 1394), a universal serial bus (USB) port, etc. An IR port may be supported using IR transmitter/receiver 94. Wireless communications circuitry 96 may include one or more antennas, transmitters, tunable transmitters, receivers, and tunable receivers. Wireless communications circuitry 96 may support remote wireless communications (e.g., cellular telephone communications, cellular modem communications to a terrestrial base station, satellite communications, etc.) and local wireless communications (e.g., a Bluetooth RF connection or other RF connection or an IR connection to a nearby wireless device).

Handheld computing device 12 may include accessories and expansion components 98. An expansion slot 100 may be used to add expansion cards or accessories to handheld computing device 12. For example, a flash card containing software or other content may be added as an expansion module. Another accessory that may be added is a bar code scanner or a radio-frequency identification (RFID) unit. Bar code scanners use light to identify products with bar code labels. RFID units may identify products by wirelessly communicating with integrated circuits embedded in or attached to or otherwise associated with products. These circuits may contain information that uniquely identifies the products.

If desired, a Bluetooth module or other wireless communications circuitry 104 may be added as an accessory or expansion module. An expansion module may be provided that provides video capabilities to handheld computing device 12 (e.g., MPEG-2 or MPEG-4 capabilities). If handheld computing device is already configured to include such capabilities, an expansion module may be provided that enhances the video capabilities of handheld computing device 12. Media drives 102 such as a CD drive, a floppy drive, a PC card reader, a memory card reader, a DVD drive, or any other suitable drives may be added to or attached to handheld computing device 12. Other accessories and attachments 106 may be used if desired. Such other accessories and attachments may include, for example, a scanner, a printer, etc.

Other components 108 that may be included in handheld computing device 12 include clock 110. Clock 110 may be implemented as one or more clock circuits or as a software timing routine or using a combination of such arrangements. A battery 112 may be used to provide power. A microphone and speaker 114 may be used to support audio functions. Audio tones and other alert signals may be presented to the user through the speaker. The microphone may be used in voice communications, voice memos, etc. Vibration unit 116 may be used to vibrate handheld computing unit 12 when it is desired to alert the user by vibrations (e.g., without disturbing people in the vicinity of handheld computing unit 12 by using an audible alert). Vibration unit 116 may be used to transmit vibrations using different codes. For example, one vibration may signify an incoming e-mail message, whereas two vibrations may be used to alert the user to a calender event. A security device that tracks whether handheld computing device 12 has been removed from a store or other establishment may be provided if desired.

An illustrative handheld computing device 12 is shown in FIG. 5. Display 118 may be a touch screen monochrome or color display, or any other suitable display screen. Keys and buttons 120 may include a power button 122, navigation keys 124, and dedicated function buttons 126. Each of the dedicated function buttons 126 may be used to perform a different task.

A generalized diagram of handheld computing device 12 is shown in FIG. 6. The device may be controlled by control circuitry 128. Control circuitry 128 may be based on one or more processors such as a microprocessor or microcontroller, application specific integrated circuits, analog-to-digital and digital-to-analog converter circuits and digital signal processors (e.g., to handle voice recognition functions and the like), and any other suitable type of processor or control circuitry. Visual information may be displayed for the user on display 130. Audio information may be presented to the user through speaker 132. Speaker 132 may be integrated into handheld computing device 12 or may be provided as headphones or any other suitable external component.

The user may provide inputs using user input interface 134. User input interface 134 may be, for example, an on-screen keyboard, a keyboard, a touch screen, a touch pad, keys or buttons, a microphone (e.g., for voice commands), a pointing device (e.g., a trackball or mouse, etc.), etc. Communications circuitry and accessories 136 may include antennas, transmitter/receivers, and other communications circuitry and may be used to handle wired and wireless communications tasks. Wireless communications circuitry may be provided for local communications functions, remote communications functions, or both local and remote communications functions. Communications and accessories 136 may include IR communications circuitry for local optical communications. Communications and accessories 136 may also include a bar code scanner for scanning bar code labels on items in stores and the like or an RFID unit for identifying items wirelessly. Other features, such as printing, scanning, and the like may be provided by other suitable communications circuitry and accessories.

Handheld computing device 12 may be used to provide a user with various communications functions, financial functions, etc. Illustrative steps involved in providing the user with such functions are shown in FIG. 7. At step 138, handheld computing device 12 may be used to provide the user with an opportunity to send and receive e-mail, telephone calls, voice mail, paging messages, data service feeds, and any other suitable information or messages. Such messages may include text, graphics, audio, and video. Audio files may be sent using any suitable audio format. One illustrative audio format for audio files is MP3. Video may also be sent using any suitable format. One illustrative video format is MPEG-4, but any suitable format may be used if desired. Text, graphics, audio, and video may be provided as part of the messages sent by handheld computing device 12 or may be provided as attachments to such mail.

If the user receives an incoming message, handheld computing device 12 may be used to present the message to the user at step 140. Text, graphics, and video may be displayed on the display of the handheld computing device. Audio and the audio component of the video may be played through the handheld's speaker or speakers.

Handheld computing device 12 may allow the user to send or forward voice mail messages and e-mail messages and the like. If the user sends or forwards a message, the system may provide the message to the appropriate recipient at step 142.

If desired, handheld computing device 12 may be used for calendar and voice memo functions. The calendar function may be provided by using handheld computing device 12 to display on-screen options that allow the user to make entries in a calendar. The voice memo functions may be used to record voice memos. Voice memos may be recorded using analog-to-digital circuitry to digitize the user's voice. The digitized signals may be stored in storage 72 (FIG. 4).

Voice memos and calendar entries may be forwarded from handheld computing device 12 to other devices, such as a personal computer, automobile personal computer, in-home electronic device, etc.

Handheld computing device 12 may be used to send and receive graphic facsimiles or images of real business cards. As shown in FIG. 8, handheld computing device 12 may provide the user with options such as send business card option 144 and receive option 146. Options such as option 144 and 146 may be displayed, for example, after a wireless link has been established between handheld computing device 12 and another handheld computing device. A confirmation message 148 may be displayed to confirm that the link has been established. The link may be established using any suitable IR communications protocols. If desired, the nature of the transmission (an image or graphic facsimile of a business card) may be identified during the link setup process. This may allow handheld computing device 12 to display options such as options 144 and 146 with little or no direction from the user. The user may generate an image of the user's own business card using a scanner. A graphic facsimile may be generated using a drawing application or the like.

Electronic business cards based on images and graphic facsimiles may include digital images of the user and may have associated audio and video clips. For example, the user's voice may be recorded and associated with the user's electronic business card. An illustrative screen 150 that handheld computing device 12 may display is shown in FIG. 9. In the example of FIG. 9, electronic business card 152 contains a graphic logo 154 and personal information 156.

Electronic business cards that the user receives from others may be organized using an address book application. Options such as option 158 may be displayed to provide the user with an opportunity to save received business cards for later retrieval.

Handheld computing device 12 may be used for financial transactions. For example, the user may pay for a product in a store by wirelessly conveying information on the user's credit card, debit card, account, or other financial information to equipment in the store such as a cash register with wireless financial transaction capabilities.

Illustrative steps involved in using handheld computing device 12 in financial transactions are shown in FIG. 10. At step 160, handheld computing device 12 may be used to provide the user with an opportunity to provide financial information to handheld computing device 12 that is to be used in a financial transactions. For example, handheld computing device 12 may present on-screen options that allow the user to enter the digits for the user's credit card, debit card, or other account. Account information may relate to an account maintained by a store, mall, or other merchant or entity, or by a third-party service provider. Handheld computing device 12 may also allow the user to enter financial information by downloading the information from a personal computer or other device, by entering the information using dedicated keys, or by using any other suitable approach. If desired, the financial information may be stored at a remote location such as on a server associated with a service provider connected to communications network 32 of FIG. 2. Handheld computing device 12 may be provided with financial information and financial transaction capabilities using a smart card attachment or smart card circuitry that is integrated into handheld computing device 12 or using smart card protocols.

At step 162, the handheld computing device may be used to provide the user with an opportunity to use the financial information that was provided to handheld computing device 12 in a financial transaction. For example, handheld computing device 12 may display an on-screen option labeled "pay now" that the user can select when paying for a product or service. If the option is displayed on a touch screen, for example, the user may select the pay now option by pressing the option on the screen. Selecting the pay now option directs handheld computing device 12 to authorize the purchase transaction. Wireless signals transmitted between handheld computing device 12 and the wireless cash register or other in-store equipment allow the cash register and handheld computing device to consummate the transaction. This type of arrangement is merely illustrative. Any suitable arrangement for using handheld computing device 12 to consummate a financial transaction based on the financial information stored at step 160 may be used if desired.

The transactions performed at step 162 may be placed under password control. The user may supply a password using keys or an on-screen keyboard. The user's identity may also be verified using handwriting or signature recognition arrangements. If desired, handheld computing device 12 may be configured to recognize a voice print or voice password. A fingerprint recognition device may be used as an attachment to handheld computing device 12 or as a part of handheld computing device 12. With such an arrangement, the user's identity may be verified for financial transactions using fingerprint recognition. If desired, a smart card key may be used as an attachment to handheld computing device 12. When the smart card is attached to handheld computing device 12, purchasing is authorized. When the smart card is not attached to handheld computing device 12, wireless transactions are prohibited. These approaches are illustrative. Any suitable approaches for verifying the user's identity may be used if desired.

The wireless financial transaction of step 162 may be performed with any suitable hardware or entity. For example, wireless payments may be made with kiosks, vending machines, ticket machines, parking garage gates, toll collection facilities, cash registers and other equipment associated with stores, malls, amusements parks, and other entities, ticket collection equipment, mass transit turnstiles and other entrance and exit equipment, parking meters, gas pumps or gas station equipment, fast food restaurants, drive through facilities, banks or any other suitable entity or equipment. Financial transactions may involve either debiting or crediting the user.

Any suitable wireless communications link may be used to consummate the wireless transaction of step 162. For example, a local IR or RF communications path may be used. Wireless financial transactions may also be performed over remote wireless links. Wired links may be used if desired. For example, the handheld computing device 12 may be connected to the other equipment being used in the transaction using a cable or by placing the handheld computing device 12 in a cradle. The cradle may be adapted to receive the handheld computing device and to form an electrical connection with the handheld computing device. The electrical connection allows the handheld computing device 12 to communicate with the other equipment during the financial transaction.

If desired, these types of communications techniques may be used for non-financial transactions, such as transactions in which information or content is exchanged rather than financial information.

When handheld computing device 12 is used in wireless financial transactions, handheld computing device 12 may retain information on each of the financial transactions. If desired, this financial information may be retained on a remote server or the like. Regardless of where the financial transaction information is stored, the financial transaction information may be used in other applications. For example, the financial transaction information may be provided to an expense report application, a tax application, a money management application or banking application, a general-purpose financial records application, etc. The financial transaction information may be provided to applications such as these using any suitable technique, such as by transferring the information to the application or informing the application where the financial transaction information is stored (e.g., on handheld computing device 12 or on a remote server, etc.).

An illustrative screen that handheld computing device 12 may display for the user when a financial transaction has been consummated is shown in FIG. 11. Handheld computing device 12 may display information on the financial transaction such as information 166. Handheld computing device 12 may also display on-screen options such as options 168 and 170 that allow the user to save the financial transaction information (e.g., information on the $156.07 purchase in the example of FIG. 11) to either an expense report application or a financial planning application. These are merely illustrative examples of ways in which to save the financial transaction information and illustrative examples of suitable applications to which the information may be provided.

Handheld computing device 12 may be used to electronically pay for train fares or other transit fares, or other services that would normally require tickets, fares, fees, etc. Handheld computing device 12 may be used, for example, to pay fees in an amusement park in which fees or tickets are collected for each ride or may be used at a ski area or the like for lift tickets. Illustrative steps involved in using handheld computing device 12 for such electronic ticketing applications are shown in FIG. 12. The steps of FIG. 12 are described in connection with electronic tickets, but this is merely illustrative. The steps of FIG. 12 apply to any type of fares, fees, etc.

At step 172 of FIG. 12, the user may be provided with an opportunity to purchase an electronic ticket. For example, a computer may be used to purchase an electronic ticket on-line over the Internet or other suitable communications network. The user or a travel agent or other suitable personnel may purchase the ticket through a web site or other suitable interface. An electronic ticket may also be purchased from a kiosk with a credit or debit card reader or the like.

Electronic tickets may also be purchased in person. A credit card, debit card, account number, or any other suitable financial instrument may be used to pay for the ticket.

Once the ticket has been paid for, handheld computing device 12 may be provided with a corresponding electronic ticket credit at step 174. If the electronic ticket was paid for in person, handheld computing device 12 may be provided with the electronic ticket from a computer at the ticket counter through a physical link or local wireless link. If the electronic ticket was purchased at a vending machine, handheld computing device 12 may be provided with the electronic ticket from a computer inside the vending machine through a physical link or local wireless link. If the electronic ticket was purchased on-line, handheld computing device 12 may be provided with the electronic ticket from the computer used to access the on-line service through a physical link or local wireless link. The server from which the on-line electronic ticket was purchased may also be used to deliver the electronic ticket to the handheld computing device (e.g., through a remote wireless link). A remote wireless link may also be used to deliver electronic tickets to handheld computing device 12 from ticket counter computers or vending machines or the like. These are merely illustrative examples of entities that may provide the electronic ticket to handheld computing device 12. Any suitable entity may provide handheld computing device 12 with an electronic ticket or other such financial instrument if desired.

At step 176, handheld computing device 12 may be used to provide the electronic ticket to a ticket collector or ticket collection equipment. If the ticket is based on a pay-per-use fare system, the user's account or may be debited by one fare. If the ticket is a monthly pass or other such multiple use ticket, the ticket collector need only verify that the user's ticket is valid.

Ticket validation or collection at step 176 may be performed using any suitable computer equipment, such as a computer located in a turnstile, a handheld computing device operated by a ticket collector, or any other suitable arrangement. The ticket collecting computer and the handheld computing device may consummate the ticket verification or collection process using a wired or wireless connection. For example, an IR link or local wireless link may be established between handheld computing device 12 and the ticket collecting device. If desired, handheld computing device 12 may display a code or image of a ticket that the ticket collector or ticket collection device can verify visually or using a scanning apparatus. These arrangements are merely illustrative. Any suitable techniques for collecting the electronic ticket may be used if desired.

Handheld computing device 12 may be used to interact with a merchant or service provider or other entity. As shown in FIG. 13, handheld computing device 12 may interact with a merchant or other entity over a wireless link 180. Wireless link 180 may be a local or remote wireless link. Merchant 178 may have an associated computer 184. Computer 184 may be located on the merchant's premises, in a nearby location, or at a remote location. Computer 184 may have an associated wireless transmitter/receiver 182. Computer 184 may communicate with handheld computing device 12 using wireless transmitter/receiver 182.

If wireless transmitter/receiver 182 supports IR communications, handheld computing device 12 may communicate with merchant 178 over an IR communications link. This type of link may be used, for example, to receive materials from a kiosk associated with the merchant 178 or other entity. IR links may also be used for local purchase transactions with wireless cash registers or the like. If wireless transmitter/receiver 182 supports local RF wireless communications, handheld computing device 12 may communicate with merchant 178 over a local RF wireless link. Such a link may be used, for example, to push promotional materials or other information to a user's handheld computing device or to consummate a wireless purchase transaction or to receive a shopping list or directory from computer 184. If wireless transmitter/receiver 182 supports remote wireless communications, handheld computing device 12 may communicate with merchant 178 or other entity over a remote wireless link. A remote link may be used to obtain a shopping list from a remote server, to retrieve a directory, to retrieve product information from a remote database, to access a remote web site containing product information or personal information, to access a service implemented at a remote service provider, etc. These are merely illustrative examples.

Handheld computing device 12 may be used to interact with a number of merchants or services in malls and other such environments. As shown in FIG. 14, each merchant 178 may have a separate computer 184. This allows merchants to handle sales and inventory on a platform that is controlled by the merchant. A user with a handheld computing device 12 may interact with a merchant using a local wireless transmitter/receiver 186 associated with that merchant's computer 184. This may allow the user to obtain, for example, information on products and services sold by the merchant.

If the user desires information that is not maintained locally by the merchant, the merchant or user may access a database on a computer such as server 188 of service provider 190 over communications network 192. Service provider 190 may be located near to the merchant (e.g., in the same mall or complex). If desired, service provider 190 may be located at a distant location.

A user may also use a handheld computing device 12 to access service provider 190 over communications network 192 using remote wireless transmitter/receiver 194. For example, a cellular telephone base station may have a remote wireless transmitter/receiver 194 with which handheld computing device 12 may communicate over remote wireless link 196.

If desired, a user may use handheld computing device 12 to access service provider 190 over communications network 192 using a local wireless transmitter/receiver 198. Local wireless transmitter/receiver 198 and remote wireless transmitter/receiver 194 need not be associated with a particular merchant. Local communications equipment such as local wireless transmitter/receiver 198 or a wireless local area network formed of such transmitter/receivers FIG. 15 may serve as a local access point to communications network 192.

When the user has access to a computer 200 (e.g., a personal computer at the office or at home), the user may access server 188 over communications network 192.

The user at computer 200 or handheld computing device 12 or a merchant 178 with computer 184 may also access a computer 202 at an order fulfillment facility 204. For example, a user at a handheld computing device that is in communication with a merchant using a local wireless transmitter/receiver such as local wireless transmitter/receiver 186 may order a product by communicating with computer 202 of order fulfillment facility 204 over communications network 192. As another example, a user at a handheld computing device that is communicating with a remote wireless transmitter/receiver such as remote wireless transmitter/receiver 194 may order a product by communicating with computer 202 of order fulfillment facility 204 over communications network 192. A user at a handheld computing device that is communicating with a local wireless transmitter/receiver such as local wireless transmitter/receiver 198 may also order a product by communicating with computer 202 of order fulfillment facility 204 over communications network 192.

Local wireless transmitter/receivers may not have sufficient range to cover an entire mall or large store. As shown in FIG. 15, a network of local wireless transmitter/receivers 206 may be used to provide local wireless communications coverage for the entire establishment. Transmitter/receivers 206 may form a wireless local area network. The spacing of the local wireless transmitter/receivers 206 depends on the size of the establishment being covered and the range of each transmitter/receiver. Local communications equipment such as local wireless transmitter/receivers 206 may serve as a local access point to communications networks such as the Internet by connecting local wireless transmitter/receivers 206 to the Internet or other such communications network.

A number of computers 208 may be interconnected with the local wireless transmitter/receivers 206. Computers 208 may be associated with merchants without local wireless transmitter/receivers such as merchants 210 and may be associated with merchants with local wireless transmitter/receivers such as merchant 212, which has an associated local wireless transmitter/receiver 214. Merchants such as merchants 210 may interact with handheld computing device 12 via local wireless transmitter/receivers 216. Merchants such as merchant 212 may interact with handheld computing device 12 via shared local wireless transmitter/receivers 216 and the merchant's local wireless transmitter/receiver 214.

Kiosks such as kiosk 216 may interact with handheld computing device 12. Handheld computing device 12 may have a computer 218 and an associated local wireless transmitter/receiver 220. Kiosk 216 may provide information over a local wireless link using local wireless transmitter/receiver 220. For example, a user may download a mall directory or the other directory from kiosk 216. Kiosk 216 may also be used as a vending machine to supply products or services to the user. The user may use local wireless communications between handheld computing device 12 and kiosk 216 to consummate a financial transaction for such products or services.

A service provider such as service provider 222 may use a computer such as computer 224 to provide services to the user, merchants, and kiosk. For example, the user may access personal information such as a personal shopping list stored on computer 224 using local wireless transmitter/receivers 206 and communications network 226. Computer 224 may be a remote server to which the local access point formed using local wireless transmitter/receivers 206 may be connected over a communications network such as the Internet or the like.

Computer 218 at kiosk 216 may access a content database on computer 224 using network 226. Merchants 210 may access a database of wireless advertisements stored on computer 224. Merchant 212 may access computer 224 to retrieve audio files and videos ordered by a user through local wireless transmitter/receiver 214. These are merely illustrative examples of the use of a network of local wireless transmitter/receivers. Any suitable arrangement of such local wireless transmitter/receivers may be used if desired.

As shown in FIG. 16, local wireless transmitter/receivers may have ranges that are localized near certain stores. For example, transmitter/receiver 226 is in the proximity of store 228. The range of transmitter/receiver 226 is shown by circle 230. Transmitter/receiver 226 may or may not be associated with or controlled exclusively by store 228. Transmitter/receiver 232 is located in store 234. The range of transmitter/receiver 232 is shown by circle 236. Transmitter/receiver 232 may be associated with store 234 and may be controlled primarily by or exclusively by store 234. The ranges of both transmitter/receivers 226 and 232 may overlap substantially with corridor 238, so that users with handheld computing devices 12 in the corridor 238 may interact with stores 228 and 234 or other entities using local wireless communications.

In the arrangement of FIG. 17, the range or footprint 240 of each local wireless transmitter/receiver covers a separate area or aisle 242 of store 244.

In arrangements such as those shown in FIGS. 15, 16, and 17, the range of each local wireless transmitter/receiver is limited. Accordingly, when a handheld computing device 12 is communicating with a particular local wireless transmitter/receiver, the location of the handheld computing device 12 can be determined. In particular, with an arrangement such as that of FIG. 16, it can be determined when the user is within the proximity of certain stores. With an arrangement such as that of FIG. 17, the particular aisle in which the user is located may be identified.

If desired, the location of handheld computing device 12 and therefore the user may be determined using global positioning system (GPS) satellites, as shown in FIG. 18. Handheld computing device 12 may receive satellite signals from GPS satellites 246. By analyzing these signals with GPS receiver 248, handheld computing device 12 can determine the location of the user. The resolution of current GPS systems is purposefully limited by the government. If a higher resolution is desired, a differential GPS (DGPS) system may be used. In DGPS systems, the known (e.g., surveyed) position of a base station such as base station 250 may be used as a reference point. By comparing the known position of base station 250 that is indicated by a GPS receiver at station 250, the error of the GPS signal in the proximity of base station 250 can be determined. If a handheld computing device 12 is relatively close to such a base station (e.g., within a number of miles), the handheld computing device's GPS location may be corrected by the same amount that was determined to be necessary to correct the position of base station 250.

If desired, handheld computing device 12 and base station 250 may be in wireless communications (e.g., over a remote wireless link 252 using antenna 254). The DGPS correction to the position of handheld computing device 12 may be made at the handheld computing device 12 (by supplying the needed correction data to the handheld computing device 12 from base station 250), at base station 250 (e.g., by providing the handheld computing device's raw GPS position to base station 250), or may be performed elsewhere (e.g., by providing an appropriate facility with the error correction data from base station 250 over a communications network and by providing the GPS position data of the handheld computing device using wireless communications and a communications network path).

Other techniques may be used for determining the location of handheld computing device 12 if desired. For example, a rough position of handheld computing device 12 may be obtained by determining which terrestrial antennas (or more broadly which satellites) are receiving communications from handheld computing device 12. An approach of this type that uses terrestrial antennas in communication with handheld computing device 12 over remote wireless links may be sufficiently accurate to place handheld computing device in a particular city or portion of a city or the like. More precise location information may be obtained using time-of-flight and triangulation techniques. Such techniques may involve the use of multiple terrestrial antennas.

These approaches, a combination of these approaches, or any other suitable location-determination arrangements may be used if desired. In a mall or boat or train or other such environment it may be desirable to provide multiple handheld computing devices with access to the Internet or the like. As shown in FIG. 19, in such an environment, each of multiple handheld computing device 12 may form a separate local wireless communication link with communications equipment 258. For example, each handheld computing device 12 may form a local RF wireless communications link with communications equipment 258. Communications equipment 258 may contain a local wireless transmitter/receiver for receiving such local wireless communications.

Communications equipment 258 may also contain suitable communications circuitry for forming a communications link 260 with a communications network 262 such as the Internet. For example, communications equipment 258 may contain communications circuitry for interfacing with a T1 line or the like. If desired, communications path 260 may be a remote wireless communications path such as a satellite path or a remote terrestrial wireless communications path. Users may access a service provider 264 with a web server 266 or the like via communications network 262.

Illustrative steps involved in using the arrangement of FIG. 19 to provide access to a remote server or the like through local wireless connections are shown in FIG. 20. At step 268, the user may be allowed to establish a local wireless communications link between handheld computing device 12 and local communications equipment 258. For example, handheld computing device 12 and local communications equipment 258 may be used to form a local RF Bluetooth link. At step 270, communications equipment 258 is used to form a communications link (e.g., a wired or remote wireless communications link) with service provider 264 so that handheld computing device 12 may communicate with service provider 264.

Shopping lists may be created using a home or office computer such as computer 272 of FIG. 21 or other in-home electronic device. The shopping list may be stored locally on computer 272 or may be stored on a remote server such as server 274 at store 276 or server 278 using communications network 280. On-line orders for products and services may be made by interacting with order fulfillment facility 282 (e.g., over an Internet link or the like using a web browser implemented on computer 272).

The shopping list may be accessed in store 276 by handheld computing device 12. For example, if the shopping list is maintained on server 274 or may be obtained from a remote location such as server 278 by server 274, handheld computing device 12 may obtain the shopping list form server 274 over a local wired or wireless link. If the shopping list is maintained at server 278, handheld computing device 12 may also access the list using a remote wireless link.

Handheld computing device 12 may have a bar code scanner or radio-frequency identification (RFID) unit 284. Bar code scanners use light to identify products with bar code labels. RFID units may identify products by wirelessly communicating with integrated circuits embedded in or attached to or otherwise associated with products. The integrated circuits may contain information that uniquely identifies the products. For clarity the present invention may sometimes be described in connection with bar code scanning. However, RFID arrangements may be used instead of bar code scanning or in combination with bar code scanning if desired.

The scanner or unit 284 may be provided as an integral part of handheld computing device 12 or may be provided as an attachment or accessory. For example, the scanner or unit 284 may be an attachment that fits in an expansion slot on handheld computing device 12.

A bar code scanner or RFID unit 284 may be used to wirelessly identify items with bar codes such as item 286. This allows handheld computing device 12 to identify items in stores, in restaurants, in malls, at home, at the office, or at any other suitable location. The user or family members in the user's household or others may use the identification feature of handheld computing device 12 to create wish lists or to add to or modify the shopping list of the user. For example, a child may use handheld computing device 12 to wirelessly identify an item in a clothing store. The identity of the item may be determined by bar code scanner or RFID unit 284. This information may be added to the user's shopping list or may be used to create a wish list for the child.

The updated and modified shopping list information and wish list information that is generated by wirelessly identifying products may be maintained at server 274, server 278, computer 272, or handheld computing device 12, or at any other suitable location. If, for example, the list is maintained at server 278, the child's or other party's addition to the shopping list may be provided to server 278 by using handheld computing device 12 to transmit this information to server 278 via a local wireless link with in-store equipment such as server 274 and communications network 280 or by using handheld computing device 12 to transmit the information to server 278 using a remote wireless link.

If the handheld computing device that is used to transmit the information is owned by the user, information on the location of the user's shopping list service or server may be obtained from handheld computing device 12. If the handheld computing device that is used to transmit the information is owned by the other party, that party may be prompted to input information such as the name of the user and the identity of the user's shopping list service provider, the user's communications address, or other information that may be used to identify the location of the equipment or service that is used to maintain shopping list information for the user.

If the shopping list is stored on a server 274, handheld computing device 12 may communicate the information on the addition or modification to the shopping list that is generated by wirelessly identifying item 286 to server 274 using a local or remote communications link. For example, handheld computing device 12 may allow the user to download the information on the wirelessly identified item to server 274 over an IR link or local wireless RF link in store 276. If the shopping list is stored locally on handheld computing device 12, information on the identified item may be added directly to the shopping list. If the shopping list is stored on computer 272, handheld computing device 12 may be used to download the information on the identified item to computer 272 over an IR link or local or remote wireless RF link. Once the shopping list has been updated, the user may retrieve the shopping list with handheld computing device 12 or other equipment for use during shopping. These are merely illustrative examples, the updated and modified shopping list information gathered by bar code scanner or RFID unit 284 and handheld computing device 12 may be added to the shopping list using any suitable communications paths if desired.

It may be desirable to provide the scanning party who performs the wireless identification with a description of the item being identified. Such a description may, for example, include information on materials, prices, features, etc. An illustrative screen 288 that handheld computing device 12 may display when bar code scanner or RFID unit 284 has identified an item such as item 286 is shown in FIG. 22. Information on the new item may be displayed in region 290. Handheld computing device 12 may display on-screen options such as options 292 and 294 to provide the user who has identified the item with an opportunity to add the item to a wish list or shopping list. A selectable option may be provided that allows the user to determine which type of list the item is to be added to. Multiple users may be supported by handheld computing device 12. Each user may access a different shopping list or wish list by providing a password or other identifier.

Handheld computing device 12 may also be used to display options such as option 296 and option 298. Option 296 provides the user with an opportunity to display the user's current shopping list. Option 298 provides the user with an opportunity to display the user's current shopping list and gift items (e.g., wish list items included in the shopping list by other users).

Handheld computing device 12 may use a database that correlates bar codes or RFID codes with different items. This allows handheld computing device 12 to display information in region 290 that includes a brief description of the identified item. The database may be maintained at a merchant or service provider or any other suitable establishment or entity. For example, the database may be maintained at server 274 or server 278 of FIG. 21. The database may also be stored on handheld computing device 12.

If, for example, the database is stored at server 278, bar code or RFID information for a identified item may be provided to server 278 by using handheld computing device 12 to transmit this information to server 278 via a local wireless link established with local communications equipment or in-store equipment such as server 274 and communications network 280 or by using handheld computing device 12 to transmit the information to server 278 using a remote wireless link. Server 278 may use the bar code or RFID information to retrieve a corresponding item description. The item description may be passed back to handheld computing device 12 using a remote wireless link or via communications network 280 and local communications equipment or in-store equipment that is in communication with handheld computing device 12 over a local wireless link.

If the database is stored at a closer server such as server 274, handheld computing device 12 may pass the bar code or RFID information to server 274 using a local or remote communications link. For example, handheld computing device 12 may be used to download the bar code or RFID information for the identified item to server 274 over an IR link or local wireless RF link in store 276. Server 274 may use this information to retrieve a corresponding item description. The item description may be passed back to handheld computing device 12 over a local wireless link. If the database is maintained by or accessed by computer 272, handheld computing device 12 may be used to download the bar code or RFID information on the wirelessly identified item to computer 272 over an IR link or a local or remote wireless RF link. Computer 272 may use the information to retrieve a corresponding item description. The item description may be passed back to handheld computing device over a local wireless link or a local wired link. These are merely illustrative examples, the bar code or RFID information may be converted into item description information using any suitable arrangement.

Moreover, the bar code or RFID information or other identifying information may be used to retrieve additional information and to access additional services related to the wirelessly identified item. For example, information identifying the product may be used by handheld computing device 12 to retrieve information such as warranty information, product reviews, video clip descriptions and promotions, advertisements and other promotional information, information on discounts, coupons and other financial benefits, comments from the general public, financing information, etc. Brochures may be requested. The user may also check to determine whether the wirelessly identified item is in stock. The user may access a price comparison service to compare the price of the scanned or otherwise wirelessly identified item to the prices of other such items. Handheld computing device 12 may be used to order the item or other items. These services may be provided using a server such as server 274 that is associated with the merchant whose item has been wirelessly identified or may be provided by a service provider or other entity with a remote server such as server 278. Order fulfillment services may be provided by an order fulfillment facility. Other entities and equipment may be used to provide services and information related to the wirelessly identified item if desired.

Handheld computing device 12 may access additional information and services related to the scanned or otherwise wirelessly identified item using any suitable communications path. For example, a database of information on a server or other computer may be accessed using a wired link, a local IR link, a local RF wireless link, physical media swapping (e.g., by transferring a removable storage media between the handheld computing device and equipment associated with the computer), using a remote wireless link, etc.

With an arrangement such as that of FIG. 2, a handheld computing device 12 that has obtained information on an item in a store or other facility 34 (e.g., by scanning the item with a bar code, by using an RFID unit, by receiving input from the user through a touch screen, or by receiving information over a local wireless link, etc.) may obtain additional information and services related to the item from computer 28 over link 52. Information and services may be obtained from manufacturer 48, service provider 46, order fulfillment facility 30, and other such entities over communications network 32. Handheld computing device 12 may be connected to communications network 32 by either a local wireless link, a remote wireless link, a wired connection (in store 34, the home or office, etc.), by a media swapping arrangement (e.g., by transferring a memory card between handheld computing device 12 and equipment in communication with network 32), etc.

If the user selects an option such as option 296 of FIG. 22, handheld computing device 12 may display a screen such as screen 300 of FIG. 23. Screen 300 may contain information such as price information, store information, and product description information in information region 302. An on-screen option 304 may be provided that allows the user to use the handheld computing device to place an electronic order for the product. This allows the brick-and-mortar shopper to place on-line products for items of interest (e.g., items that have been identified by bar code scanning or RFID identification techniques in a store. If the user selects option 304, the user may be provided with on-screen options that allow the user to order the product and other products.

For example, if the user is in a Gap clothing store and the user scans or uses RFID to identify a sweater, information on the price of the sweater and description of the sweater may be displayed as shown in FIG. 23. If the user selects order now option 304, the user may be connected to a Gap web site or other such on-line site that allows the user to order the sweater and any other Gap products offered for sale at the site. The on-line site may be a publically accessible web site that may be reached from any computer connected to the Internet or may be a site that is only accessible to users with handheld computing devices.

If desired, the on-line site may only be available to in-store shoppers. As an example, the site may be accessed using a local wireless link. Because it is known that users accessing the site through this communications path are in the immediate vicinity of the store, the site may provide the user with different services (e.g., prices, shipping and service options, product offerings, etc.) than users who access the Gap's regular Internet web site. This type of segregation technique may be used regardless of whether the user accesses the shopping service using a local communications path or a remote communications path. For example, users who access the site using a remote wireless communications link may be identified based on location information (e.g., GPS location information, etc.).

When a product has been identified to handheld computing device 12 in a store or other establishment, the user need not order that product immediately. Rather, the user may save the identified information for use during a later purchasing transaction (e.g., through a web site). An illustrative web site ordering arrangement that may be used to provide the user with an opportunity to order items previously identified in a store using handheld computing device 12 (e.g., by scanning or RFID identification) is shown in FIG. 24. Screens such as screen 306 may be displayed using a web browser implemented on the user's home or office personal computer or other suitable device. Screen 306 may contain information 308 on each item that was identified in the store. Some of the items in the list on screen 306 may have been added to the list by the user from the web site or other on-line shopping service, rather than through the handheld computing device 12. If desired, both types of items may be listed on screen 306. Options such as option 310 may be provided to allow the user to add an item of interest to the user's shopping cart. This is only illustrative. Any suitable web-based ordering scheme may be used to order the items shown in screen 306 if desired.

Illustrative steps involved in ordering products that are identified in a store using handheld computing device 12 are shown in FIG. 25. At step 312, the user may be provided with an in-store opportunity to add an item to the user's shopping list. The item may be added to the list by bar code scanning, by using RFID identification, by entry of product information into handheld computing device 12 using on-screen options, by receiving product information over an IR link (e.g., from a kiosk or terminal associated with the store or adjacent to the product), by using an memory card to pass information to handheld computing device 12, by a remote wireless link, by a wired link, or using any other suitable technique.

At step 314, the user may be provided with an opportunity to purchase the item and other items. As an example, the user may purchase the item from an electronic service maintained by the merchant and accessed over a local IR or RF wireless link. The user may also purchase the item from a web site or other electronic service. Such a site or service may be accessed by handheld computing device 12 over a remote wireless link (e.g., using a cellular modem link to the Internet). The site or service may also be accessed over the Internet from a personal computer or other electronic device. These are merely examples, any suitable technique may be used to allow the user to use handheld computing device or other equipment to order the item. Regardless of whether the user orders the item using a handheld computing device or whether the user orders the item using a personal computer or other electronic device, the order may be fulfilled at step 316 (e.g., by an order fulfillment facility to which the order has been transmitted over an electronic link). The order fulfillment facility may be associated with a central warehouse that serves customers over a wide geographic region or may be a facility that is associated exclusively or primarily with the store in which the item was identified.

Steps involved in allowing the user to use handheld computing device 12 or other equipment to identify products, categories of products, manufacturers, etc. and in providing the user with related information and services are shown in FIG. 26.

At step 318, the user may be provided with an opportunity to identify an item, category of item, manufacturer in a store or other establishment. An item, category of item, or manufacturer may be identified in a store or other establishment by bar code scanning, by RFID identification techniques, by entry of product information into handheld computing device 12 using on-screen options, by receiving product information over an IR link (e.g., from a kiosk or terminal associated with the store or adjacent to the product), by using an memory card to pass information to handheld computing device 12, by a remote wireless link, by a wired link, by selecting from on-screen options that list products by categories or manufacturers, etc., or by using any other suitable technique. If desired, the item, category of item, manufacturer, etc. may be identified using in-store computer equipment or the like. For example, personnel in the store may provide information identifying an item, category of item, or manufacturer into an in-store computer.

At step 320, the user may be provided with an opportunity to use handheld computing device 12 or other equipment to obtain information and access services related to an item, category of items, manufacturer, etc. For example, handheld computing device 12 may be used to provide the user with information and other services while the user is in the store or establishment or in the vicinity of the store or establishment. Handheld computing device 12 may also be used to provide the user with information and other services after the user has left the store. In-store equipment and home or office equipment or the like may be used to provide the user with information and services related to the item, category of item, manufacturer, etc.

Information and services may be provided to the user from an in-store computer, a server or other computer associated with the store or other establishment, a remote server at a service provider or other entity, or using any other suitable arrangement. Product ordering services may be provided using equipment in the store or using a remote order fulfillment facility (e.g., for orders to be delivered). Any suitable communications paths may be used to provide information and services to handheld computing device 12. For example, while handheld computing device 12 is in a store, a communications link may be established between handheld computing device 12 and the store over a local wireless IR or RF link, a remote wireless link, a wired connection, etc. Information and services may also be provided to the user at handheld computing device 12 using transferable storage media (e.g., memory cards or the like). These are merely illustrative examples. Any of the communications techniques that have been described previously may be used to provide information and services to the user at step 320 if desired.

An illustrative screen 322 that may be displayed by handheld computing device 12 when an item in a store has been identified is shown in FIG. 27. Screen 322 may contain information such as model number information 324 and product description information 326. On-screen options may be provided that allow the user to obtain information and to access services.

For example, option 328 may be provided that allows the user to request a brochure on the identified product. If the user selects option 328, the user's brochure request may be passed to an in-store computer or an appropriate service provider. Brochures may be delivered to the user's home in physical form or may be delivered to the user's home or handheld computing device 12 electronically. For example, an electronic brochure may be provided to handheld computing device 12 using a local wireless link in the store.

Option 330 may be used to allows the user to obtain information on warranties. If the user selects option 330, handheld computing device 12 may be used to provide the user with information on the warranties offered by various manufacturers or information on the store warranties offered by the store. This information may be supplied to handheld computing device 12 from a computer associated with the store over a local wireless link or using any other suitable arrangement. If desired, handheld computing equipment 12 may be used to display options that allow the user to electronically purchase an extended warranty from the store or the like.

The user may desire to finance the purchase of the item. Option 223 may be used to allow the user to obtain information on financing (e.g., from a computer associated with the store over a remote or local wireless link or a wired link). If the user selects option 332, handheld computing device 12 may be used to display information for the user on various financing packages available from manufacturers, banks, and the store. If desired, only information on the store's financial packages may be made available to the user.

Option 334 may be used to allow the user to check the store's current stock. If the user selects option 334, the store's computer database may be checked to determine whether the desired item is currently in stock. Information on whether the item is in stock may be provided to handheld computing device 12 over a local or remote wireless link, a wired link, or other suitable path. The information may be displayed for the user by handheld computing device 12.

Option 336 may be used to allow the user to view information on reviews on the desired item. For example, reviews from the press or from the store may be provided to handheld computing device 12 from a computer associated with the store or other suitable equipment (e.g., over a local or remote wireless link, a wired link, or other suitable path) and displayed for the user.

Option 338 may be used to allow the user to view customer comments and the like. The user may also be provided with an opportunity to add comments. The customer comments may be stored on the store's computer or may be stored remotely (e.g., on a remote server associated with a service provider or the like). The customer comments may be provided to handheld computing device 12 from the computer associated with the store or the remote server (e.g., over a local or remote wireless link, a wired link, or other suitable path) and displayed for the user. If the user adds comments, the comments may be transmitted from handheld computing device 12 to the store's computer or the remote server.

Options 340 may be used to allow the user to view video related to the desired item. For example, the store or a manufacturer or a service provider may maintain a library of video clips associated with various products, categories of products, and manufacturers, etc. If a video is available for the desired product or category of product or the manufacturer of the product, the video may be provided to handheld computing device 12 and displayed for the user. The video may be displayed for the user while the user is in the store, to assist the user in determining whether or not to purchase the desired item.

Video may be distributed to handheld computing device 12 using any suitable communications path. For example, video from the store may be distributed from equipment in the store (e.g., a computer) over a local IR or RF wireless link, a remote wireless link, a wired link, or any other suitable link. Video from a remote server may similarly be distributed over a local IR or RF wireless link (e.g., through a local transmitter/receiver associated with the store or other local establishment), a remote wireless link, a wired link, or any other suitable link. The videos may be produced by the store, by independent product reviewers, by the manufacturers, or by any other suitable entities. Videos may be distributed in real time or may be downloaded as video clip files that may be played back by handheld computing device 12 after the file has been downloaded or after a sufficient portion of the downloading process has been completed.

Advertisements and other promotional material may be displayed by handheld computing device 12. In general, advertisements and promotional material may contain text, graphics, and video. Audio may accompany the text and graphics or may be part of the video that is being presented. Promotional material may passive or interactive. Passive promotional material and other content may be provided using a unidirectional communications path or a bidirectional communications path. Interactive promotional material and other content may be provided using a bidirectional communications path. Interactive material may be selected by the user. If, for example, handheld computing device 12 has a touch screen, the user may select a displayed advertisement or other promotional material or content by pressing the screen where the advertisement or other material is being displayed. As shown in FIG. 27, an advertisement 344 may be displayed on the same screen as various user-selectable options.

Option 342 may be used to allow the user to compare prices for the desired item. If the user selects option 342, handheld computing device 12 may display a screen such as screen 346 of FIG. 28. Screen 346 may contain information 348 on the desired item. Screen 346 may also contain information 350 on the identities of various on-line retailers and the prices of the item at each such retailer. An option such as an order now option 352 may be associated with each retailer. If the user selects one of these options, the handheld computing device 12 may display the retailer's on-line shopping portal to the user. The desired item may be preselected, so that the user does not need to search within the on-line retailer's site.

Screen 346 may also include information 354 on various brick-and-mortar retail establishments. If the user selects one of directions options 356, handheld computing device 12 may obtain directions (e.g., from a remote server) and may display these directions for the user. If the user selects one of the call now options 358, handheld computing device 12 may establish a telephone link with the associated brick-and-mortar store, so that the user may obtain information about that store from personnel at the store who answer the telephone or from an automated telephone answering system.

When the user is in the vicinity of a store, the user may obtain product information and access services related to the products and services of the store and the manufacturers associated with these products and services. Handheld computing device 12 may be used to obtain such product information from a local computer associated with the store or from a remote computer (e.g., a remote server associated with the store, a manufacturer, or service provider, etc.) A local wireless link (e.g., a local wireless link with the computer associated with the store or with a local access point in the vicinity of the store) may be used to provide the requested information wirelessly to handheld computing device 12.

The user may obtain information and access services related to a product, category of product, manufacturer, etc. by interacting with on-screen options displayed by handheld computing device 12 using a shopping assistance application or service. An illustrative screen 360 that may be used by handheld computing device when providing these features to the user is shown in FIG. 29. An option such as view by manufacturer option 362 may be used to access a list of manufacturers who have available services. An option such as view by product type option 364 may be used to access services by product type. An option such as search option 366 may be used to allow the user to search for information and services of interest. After the desired search string has been provided to handheld computing device 12 using option 366, the user may select go option 368 to initiate the search.

An illustrative screen 370 that handheld computing device 12 may display when the user selects option 362 of FIG. 29 is shown in FIG. 30. Screen 370 may contain a list 372 of selectable manufacturer names. When the user selects a desired manufacturer, the information and services that are available that are associated with that manufacturer may be displayed on the screen by handheld computing device 12.

An illustrative screen 374 that handheld computing device 12 may display when the user selects option 364 of FIG. 29 is shown in FIG. 31. Screen 374 may contain a list 376 of product categories. Logos 378 or other suitable promotional information may be displayed adjacent to various product categories. Manufacturers or others may sponsor such logos. If a particular logo catches the attention of the user, the user may select the logo. When a logo is selected, handheld computing device 12 may take the user to the manufacturers on-line site, may display information on the manufactures product, may provide the user with an opportunity to purchase the manufacturers products or obtain additional information regarding those products, etc. Promotional materials such as advertisement 380 may also be displayed on screen 374.

If the user performs a search using search option 366 of FIG. 29, handheld computing device may display a search results screen such as search results screen 382 of FIG. 32. Screen 382 may contain a list 384 of various products that match the search criteria. The user may view information on a product of interest by selecting the appropriate view information option 386. When the user selects a view information option 386, handheld computing device 382 may access and display information on the product such as text descriptions of the product, images of the product, promotional videos, or any other suitable information related to the product.

In the example of FIG. 32, an entry 388 in the search results corresponds to general promotional information associated with a manufacturer's line of products. If the user selects the associated view info option 390, handheld computing device 12 may display a screen such as screen 392 of FIG. 33. Screen 394 may contain a video region 394 in which a real-time or downloaded video clip may be presented related to the manufacturer's products. Information region 396 may be used to display text and graphics related to the products. For example, information region 396 may be used to display a list of product features, ratings, consumer reviews, test report results, lists of available accessories, information on compatible equipment, etc.

If the user selects an option such as the view info option 386a of FIG. 32, handheld computing device 12 may display a screen such as screen 398 of FIG. 34. Screen 398 may contain information 400 identifying the product of interest and information 402 indicating whether the store has the product in stock. Information on whether the item is in stock may be obtained from any computer associated with the store that has access to current inventory information. This information may be stored on a local computer or a remote server. Video such as promotional video on the product or the manufacturer's line of products or any other suitable subject may be displayed in video region 404. Product specifications may be displayed in region 406.

Order now option may allow the user to order the product in the store. The product may be ordered from the store or from a service provider. If the product is ordered from the store, the user may be provided with an on-screen option that allows the user to decide whether to take the product home from the store or to have the product delivered. If the product is ordered from a remote service pro