Systems and methods for organizing and validating data in documents6954766Abstract The invention relates to systems and methods to validate data in a design document transmitted over a computer network from a design organization to a contract manufacturer for manufacturing a product. The computer implemented system includes computer software for storing a past version of the design document, receiving and storing a new version of the design document, storing a dictionary, comparing the new version to the past version of the design document to detect a change in the data. If there is no change, the program stops. If there is a data change, the software sets the past version to the new version of the design document, and uses the dictionary to correct and validate the data that has changed between the past and new version which results in a design document with data to use for the contract manufacturer only. Claims 1. A method of validating information comprising data in a design document in a relational database, comprising: Description BACKGROUND
As shown above, the BOM of the electronic product 123 lists five 1-kiloohm resistors, three 1-microfarad capacitors, a PCB, and an ASIC. Assembly instructions and drawings describe how the electronic product will be assembled. The second document is the AML, which lists all of the parts with their approved suppliers: Below is a simplified example of the AML:
The AML lists the approved resistor is the Acme 234, the approved 1-microfarad capacitors are either the Acme 345 and the Smith 467, Jones supplies the PCB 567, and Adams the ASIC 678. Because the PCB and ASIC are custom manufactured, they do not have a supplier part number. The symbol " below part number 789 indicates there are alternative sources of the capacitor. Once the design organization selects its parts from the approved suppliers, the contract manufacturer can assign its own part numbers so the parts can be ordered again. Now assume the design organization introduces an error in the AML:
Assuming that the first AML is correct, the error is that the resistor is misidentified as part number 239. If undetected, the contract manufacturer will order the wrong resistor. A worker may detect the error by noting Acme part number 239 is not a 1-kiloohm resistor, but this is not a reliable way to correct the error. The added part numbers for the PCB and ASIC must be protected from being overlaid (e.g., overwritten) when the design organization sends a new version of the AML to add, change, or remove parts in the AML. For example, the design organization may remove the Smith capacitor because it costs more than the Acme capacitor producing an AML as follows:
Because the contract manufacturer did not protect the correction of the misidentified resistor part number in this example, the incorrect resistor part number 239 reenters the AML when the design organization sent the new version of the AML. This illustrates some of the reasons there is a need to shift the work of comparing, updating, filtering the data found in design documents from workers to computers. SUMMARY OF THE INVENTION The invention relates to the integrity of information exchanged on computer networks. For example, the invention relates to when an organization sends documents to another organization for manufacturing, the documents may have errors and, once detected, the errors may not be corrected in the sending organization's documents. The documents may be resent with a small changes or perhaps no changes at all, but may have errors that have been seen before. The documents may have data that is irrelevant to the receiving organization. The invention provides for filtering of irrelevant data. A dictionary is used to validate and correct the documents. Changes and filtering of the dictionary may also occur to prepare the information used by the receiving organization for processing. The invention provides a system and method for use with a computer that aids in the validation and correction of information in a document, in that it detect changes in the document when resent so that the changes are validated or corrected, can filter the document so that only relevant items are processed, detects changes in the dictionary so that only changes are processed, and filters the dictionary so that only relevant data in the dictionary is processed. In addition, the invention initializes information in tables that are in use and assumed to be valid to avoid unnecessary validation and correction. BRIEF DESCRIPTION OF THE DRAWINGS FIGS. 1A-1C illustrate some ways contract manufacturers use the information contained in design documents to manufacture products. FIG. 2A illustrates a system, including a change detection function, for organizing and validating data contained in design documents transmitted from a design organization to a manufacturing organization. FIG. 2B illustrates the system of FIG. 2A with the addition of a filter function to remove data contained in design documents that is not useful to the contract manufacturer. FIG. 3A illustrates the system of FIG. 2B with the addition of a dictionary change function to update the dictionary used to validate and correct the data contained in design documents. FIG. 3B illustrates the system of FIG. 3A with the addition of a filter function to remove data contained in the dictionary that is not useful to the contract manufacturer. FIG. 4 is a flowchart of the software program depicted in the block diagram of FIG. 2A. FIG. 5 is a flowchart of the software program depicted in the block diagram of FIG. 2B. FIG. 6 is a flowchart of the software program depicted in the block diagram of FIG. 4, which permits using the validated data from the table Data to Use to avoid revalidation of data known to be correct. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The invention relates to the integrity of information exchanged over computer networks. One example is where a design organization creates documents that are sent over the Internet to a manufacturing organization to be used to manufacture a product. Background for suitable computer networks, e.g., the Internet, to use in conjunction with the invention are discussed in Tannebaum, Computer Networks, third edition (1996), and Stevens, TCP/IP Illustrated, Volume 1 (1994), which are hereby incorporated by reference. Background for suitable database and application server architecture to use in conjunction with the invention is discussed in Loney and Koch, Oracle 8i: The Complete Reference (2000), Greenwald et al., Oracle Essentials: Oracle 9i, Oracle 8i & Oracle 8 (2001), and Kyte, Expert One-On-One Oracle (2001), which are hereby incorporated by reference. The information exchanged is preferably stored in tables in relational database(s) running on a suitable operating system, such as WINDOWS, UNIX, LINUX running on one or more (e.g., a cluster) compatible computer(s) using Intel, AMD, and/or Sun processors. Table 1 represents an AML to manufacture a product. A typical AML will list more parts, but it is not necessary to expand this AML to understand this aspect of the invention. Each column heading in Table 1 describes the data found in that column and each unique set of data has its own row. For example, the first row consists of the design organization's part number 456, a 1-kiloohm resistor, supplied by Acme as part number 234. A change in the description, the part supplier, or supplier part number is considered to be a change on the row.
The Change Detection Function FIG. 2A shows one flow path of the present invention, which includes the change detection function. The contract manufacturer can implement this in software with the ORACLE 9iAS application server and ORACLE 9i database, and will store two versions of Table 1 in the database. The first version named table Past contains the most recent AML sent by the design organization, and the second version named table Data to Use contains the validated or corrected data for the contract manufacturer to use to make the product. For example, the application server and relational database receive and store a new version of the design document 10 and compare the new version with the past version to detect change 11. If there is no change, the flow path ends. If there is a change, the software sets the past version to the new version, then validates and corrects data 12 based on a reliable source 14 of a dictionary 15, resulting in data to use 13 to manufacture the product. Referring to step 40 of FIG. 4, the software program initializes the table Past and the table Data to Use to null values. Null represents the lack of a value. At step 41, the contract manufacturer receives Table 2—New Version from the design organization, which misidentifies Acme resistor part number as 239 rather than 234.
At step 42, the program compares Table 2—New Version to the table Past to detect if there is any change. Because the initialization step set all the data in table Past to null values, none of the data in the Table 2—New Version matches the data in the table Past. Accordingly, at step 43, the table Past is set to the table New Version as shown as Table 3—Past below.
At step 44, the data is validated and corrected, including the resistor part numbering error, using a source 45 of a reliable dictionary 46, which may be stored in, among other things, a catalog, CD, Web site, or other data storage system. At step 47, Table 4—Data to Use is set to the table Validated/Corrected New Version.
Table 4—Data to Use, however, still needs the supplier part numbers for the PCB and ASIC. Thus, the contract manufacturer transmits the specification of the PCB to Jones, which informs the part number is 567A, and transmits the specification of the ASIC to Adams, which informs the part number is ABC678. The contract manufacturer adds these part numbers to the table Data to Use, which then appears as Table 5—Data to Use.
Next, the system addresses the event of supplier change. For instance, suppose the design organization decides New Tech should replace Smith as the supplier of capacitors. To inform the contract manufacturer of this change, the design organization transmits Table 6—New Version, which is received by the contract manufacturer at step 41.
In reviewing Table 6—New Version, which is what the design organization possesses and just transmitted to the contract manufacturer, one gleans the design organization's AML is not "up to date." It still has the Acme resistor part numbering error, and the Jones and Adams part numbers are missing, because the contract manufacturer did not notify the design organization of errors and omissions in the design documents to prevent its competitors from free riding on its corrections. In fact, the invention's ability to tolerate "noisy" design documents is a practical advantage and makes it useful for cleaning up design documents while protecting the contract manufacturers' interests. Referring to FIG. 4, at step 42, the program compares Table 6—New Version to Table 3—Past and detects that New Tech replaced Smith as supplier of the capacitor. Thus, at step 43, the program updates the table Data to Use by replacing Smith and its part number with New Tech and its part number. The program does not, however, detect a change in the resistor part number nor the added Jones and Adams part numbers so that correct data remains unchanged. Table 7 illustrates the table Data to Use after this step 43, which is ready for use in manufacturing. However, if desired, in another feature, the program can validate the New Tech part number at step 44 and sets table Data to Use to the Validated/Corrected New Version at step 47.
The Filter Function As mentioned earlier, the AML of the design organization may encompass all of its product offerings, which means the AML may list parts, which are irrelevant to the contract manufacturer making a certain product. The invention provides a filter function to exclude the irrelevant data as illustrated in FIG. 2B and FIG. 5. The contract manufacturer can implement this software with Oracle architecture and technologies as before, and again stores two versions of Table 1 in a database. The first version named table Past contains the most recent AML sent by the design organization, and the second version named table Data to Use contains the validated or corrected data for the contract manufacturer to use to make the product. FIG. 2B shows the filter function in the flow path illustrated in FIG. 2A. As shown, the software, application server and relational database receive and store a new version of the design document 10, filter the new version 16 for relevant information and compare the new version with the past version to detect change 11. If there is no change between the past and the new version, the flow path ends. If there is a change, the software sets the past version to the new version, then validates and corrects data 12 based on a reliable source 14 of a dictionary 15, resulting in data to use 13 to manufacture the product. At step 50 shown in FIG. 5, the program sets the table Past to null values. At step 51, the contract manufacturer receives the AML sent by the design organization, which includes irrelevant parts not used by the contract manufacturer and for which validating and correcting will not have value. Table 8 illustrates the AML sent by the design organization and received by the contract manufacturer.
At step 52, the program retrieves the relevant part numbers, e.g., from the table Data to Use. This step results in Table 9—Filter from Data to Use below:
At step 52, the program also uses Table 9 to filter Table 8—New Version so that only relevant rows of Table 8—New Version pass to the change detection function. The filter function also detects if a relevant row is missing from Table 8—New Version, because this must be also passed to the change detection function. The result of step 52 is the Table 10—Filtered New Version below.
At step 53, the program operates on Table 10 as before, namely, the change detection function compares Table 10—Filtered New Version to the table Past and detects if there is a change. If there is a change, the program sets the table Past to Table 10—Filtered New Version at step 54. At step 55, the program uses the dictionary 57 from the source 56 to validate and correct Table 10—Filtered New Version. Finally, at step 58, the program sets the table Data to Use to the validated and corrected Table 10. The Dictionary Change Detection Function Each part and/or material supplier has a catalog or some other listing of its parts and materials that can be used as the dictionary 15 shown in FIGS. 2A-6 to validate and correct the AML and the BOM. The catalog is typically in paper, CD's, and/or increasingly on web sites in, for example, HTML, XML, and PDF formats. Of course, from time to time, the supplier will introduce new parts, change parts, and discontinue parts. However, the design organization may not be aware of these changes and may not change its own AML to reflect the changes and transmit them to the contract manufacturer. On the other hand, the contract manufacturer can address this information gap by subscribing to the supplier to receive the updates to the catalog or subscribe to a service that provides these updates. Each release of the catalog may have changes from the last release. Some catalogs flag the changes since the last release, but nevertheless require the subscriber to stay current to use these flags and missing one release can make the flags for the next release invalid. The invention provides for a dictionary change function, implemented in a manner similar to the design document change detection function described earlier where the relational database stores a table Past Dictionary that keeps the values from the previous release of the dictionary. The dictionary change detection function is illustrated in FIG. 3A. To carry out this function, the contract manufacturer stores two versions of the dictionary in a relational database, namely, in a table named Past Dictionary and in a table named Dictionary to Use. As discussed before, the source 14 provides a dictionary 15, for example, Table 12 to validate and correct 12 the AML from the detect change function 11. The contract manufacturer may then receive a release of the catalog, for example, Table 13 that flags changes in the dictionary 15. The program then compares the release of the dictionary with the past dictionary to detect a change 17. If the program detects a change, the program changes the past dictionary 15 such that it becomes the new version of the dictionary used to correct and validate the table Data to Use 13. As a result, the AML stored in the contract manufacturer's database is accurate, up-to-date with the supplier catalogs, and ready to use for manufacturing the product. Table 12 represents the table Past Dictionary for Acme.
To better understand how the dictionary change detection function is implemented suppose Acme changes the part number for the 1-kiloohm resistors. This change could be for many reasons. One reason might be a change in the manufacturing process improves the resistors' tolerance. The change is published in a release of the Acme catalog, and stored in the table New Version represented in Table 13.
Part numbers 234 and 235 are detected as changes from the table Past Dictionary, thus the part numbers and description are changed as discussed above. The updated dictionary is then used to correct and validate the table Data to Use. Table 14 illustrates the table Data to Use after Dec. 1, 2001:
The Dictionary Filter Function Supplier catalogs typically list many parts and materials. Thus, many changes in the dictionary are irrelevant to a contract manufacturer making a given product and should be filtered out. Otherwise, the program updates the dictionary based on changes to irrelevant data. FIG. 3B illustrates the system of FIG. 3A with the addition of a filter function to remove irrelevant data contained in the dictionary. As shown, the filter 18 (depicted as Table 15—Part Filter) limits the changes to the dictionary 15 to only those of interest as discussed above in connection with the design document filter. Unlike the document filter, the catalog filter must also detect if a catalog entry is missing. This will cause it detect the change in the Acme 1-kiloohm resistor even if Acme fails to indicate the change to part number 234 to 235 since part number 234 would be missing from the Acme catalog.
Adding a Part Number to the Filter To assure that all the required part numbers are available to the filter 16 shown in FIGS. 2A, 2B, 3A, 3B, and 5, the program compares each part number in a BOM 70 with the contents of the part number associated with filter. If a part number in the BOM 70 is not available to the filter 16, the part number is added to the filter 16 and the design organization part number, the associated supplier, and the supplier part numbers are added to the table Past, and the validated and corrected data are added to the table Data to Use. If the part number is not in the unfiltered AML 10, then the program and/or contract manufacturer can request that the part number be transmitted from the design organization. The Initialization Function The contract manufacturer may have validated the table Data to Use and want to use the change detection function in FIGS. 4-6 and the filter function in FIG. 5 without revalidating all of the data. FIG. 6 illustrates this embodiment, where the table Data to Use can initialize the table Past so that the change detection function can be used for subsequent releases of the AML. In the AML, the variable data that are subject to error are the supplier name, the supplier part number, and the part description. Thus, at step 60, the program extracts the part number data from the table Data to Use, and sets each supplier name, supplier part number, and part description to "*", which is a specific value that signals that the current version of the AML provides the data. Table 16 represents the table Data to Use and Table 17 represents the table Past derived from table Data to Use after initialization as discussed.
At step 61, the program, application server, and database receive and store Table 18—New Version:
At step 62, the change detection function determines Table 17—Initialized Past does not Table 18—New Version, and moves to step 63. At step 63, the program detects the data in Table 17—Initialized Past (except the far left column) is set to "*" as discussed earlier so the program moves to step 64. At step 64, the program sets Table 17—Initialized Past to Table 18—New Version, producing Table 19—Past After Processing New Version below.
Because incorrect Acme part number 239 is in the table Past After Processing New Version when a matching AML is subsequently received at step 61, the program will not detect change at step 62, and will not therefore invoke the validation and correction of the AML at step 66 using the dictionary 68 from the source 67. This initialization process does not add risk if the program validated the New Version as discussed above. However, the functions are now ready so that the full change detection and filter functions can be used. Duplicate Use of Part Numbers Some design organizations use the same part number to designate different parts, which can lead to misunderstandings and errors. However, since the practice exists the contract manufacturer should be able to accommodate it. To understand how, let's assume the design organization instructs the contract manufacturer to make an electronic product 123 using Table 20—BOM and Table 21—AML, and the Table 22—Data to Use is as shown below:
Now assume the design organization instructs the same contract manufacturer to manufacture a new related electronic product designated part number 124. To do, the design organization sends the following Table 23 and Table 24, the BOM and the AML, respectively, for electronic product 124.
Comparing the AMLs, in Table 21, the PCB is part number 567, and in Table 24, the PCB is part number 568. The change detection function detects this change in part number, and determines the two sets of tables contain different PCBs. Likewise, the change detection function detects that different ASIC exist in Table 21 and Table 24, and the same capacitor exists in Tables 21 and 24. Now assume the design organization designates a 1-kiloohm resistor as part number 456 Table 21—AML for electronic product 123, but reuses part number 456 for a different part, namely, the 1-kiloohm resistor 5% in Table 24—AML for electronic product 124. This may very confusing, however, because the supplier resistor part numbers differ in Tables 21 and 24, the change detection function detects the change. The program and/or contract manufacturer can contact the design organization, which respond, for example, that part number 456 used to make electronic product 123 is really different than part number 456 used in electronic product 124. However, the table Date to Use only permits one mapping of the design organization part number to the supplier and to supplier part number, and a second mapping may make data processing ambiguous if not impossible to implement. In an embodiment, the program addresses this problem as follows. It changes the design organization part number as shown in Table 25—the BOM, and the corresponding entry in Table 26—the AML, Table 27—Data to Use, and Table 28—New Past. In an embodiment, the program changes the part number by appending a distinguishing symbol to it, such as suffix "%A" to distinguish the duplicate use of the same part number.
It should be understood from the above, that the repeated part number 456 in Table 28 is different from the repeated entries for part number 789 in that there are two different uses of the part number 456.
|
Same subclass Same class Consider this |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||