Free cookie consent management tool by TermsFeed

Reconcile Doc Extraction Results

When you run through your document extraction process, most of the work occurs in the background. It's only after the Start Doc Extraction Smart Service or Extract from Document smart service extracts data from a document that the Reconcile Doc Extraction Smart Service generates a task for a user to validate the data.

The reconciliation task plays an important role in making auto-mappings smarter. As you complete reconciliation tasks, Appian learns how to map the data in your documents to the proper fields in your data type. Over time, this will make auto-extraction more accurate and reconciliation easier and less frequent.

Learn more:

Note:  Learned mappings are dependent on the data type's fields. If you change the fields or make a new data type, it will not use the learned mappings.

Complete the reconciliation task

The reconciliation task is auto-generated by the Reconcile Doc Extraction Smart Service.

To complete the reconciliation task, users will compare the data that was extracted to an image of the uploaded document. They can use the information that displays in the document preview to update any incorrect or missing information.

To complete the reconciliation task:

  1. On the left side of the page, review the information in the fields. Use the document preview on the right to verify the accuracy of the data.

    • Note: To see where the information in the fields came from, select the field and the value is automatically highlighted in the document preview.

      images/doc_extraction/see_where_values_came_from.gif

  2. If any information is missing, you can populate the information in three ways:

    Tip:  Values selected from the document preview will improve data extraction results. Values entered manually will not. For example, if you select the value for a PO number from the document preview in two different documents, it can learn that PO No. and PO # both mean PO Number. If you have the option, you should select correctly labeled values from the document preview instead of entering them manually.

    • Place your cursor in the field, then click the box that surrounds the desired value.

      images/doc_extraction/field_to_box_map.gif

    • Click the box that surrounds the desired value in the document preview on the right, then click the arrow next to the field to populate the field.

      images/doc_extraction/box_to_field_map.gif

    • To select text that was not automatically extracted, press and hold the Shift key while dragging the mouse.

      images/doc_extraction/manual_entry.gif

  3. Perform additional reconciliation for tables, if they appear in the document preview.

  4. After all fields are verified and populated, click RECONCILE.

While you are reconciling the data, icons indicate how the information was entered for each field:

  • No icon: Value was entered manually
  • Magic wand icon : Value was entered automatically during data extraction.
  • Link icon : Value was selected from the document preview.

user_guide_reconciliation_icons

Reconcile table data

Many document types include tables to organize information. Appian can extract this information efficiently and present it in a reconciliation task to confirm it did so properly. If a user finds that the table was incorrectly detected, they can now manually draw the boundaries to extract the information as intended.

This page describes how to reconcile data extracted from tables, as well as the steps to draw a table boundary for extraction in case the service doesn't parse the data in the table correctly.

You'll reconcile table data as part of the overall doc extraction reconciliation task.

  1. Under the relevant field in the left-pane, click Select Table.
  2. Select your table and identify the header row.
  3. Choose which field in each column header corresponds to the column in the table.
  4. Remove rows that don't contain actual table data, described below.
  5. Verify your data is correct.
  6. Click OK.
images/doc_extraction/table-reconciliation.gif

Tip:  As users submit document extraction tasks, Appian will learn the aliases for your tables' column headers. It can then use the learnings to automatically extract table values, reducing the need for human reconciliation.

Table actions

When manually extracting table data, users can take a variety of actions by clicking on the menu icon next to a column or row.

For columns, users can:

  • Duplicate a column
  • Insert a column to the left
  • Insert a column to the right
  • Remove a column
images/doc_extraction/column_controls.png

For rows, users can:

  • Duplicate a row
  • Insert a row above
  • Insert a row below

Users can also remove individual rows by clicking the close icon on the right side of each row

images/doc_extraction/row_controls.png

Create a table manually

When extracting data from documents, you may find that some tables aren't correctly identified. Or, when the table is identified correctly, the table's columns or rows were split incorrectly. When this happens, Appian has trouble automatically extracting the information and presenting it in a reconciliation task.

Rather than manually fixing this data field by field, Appian lets you draw the boundaries of a table for more precise data extraction. After you draw the table boundaries, Appian will extract data from the selected location. The table reconciliation task shows a more accurate picture of the data.

Note:  You'll need to manually draw these tables in each document where they aren't correctly identified.

To draw table boundaries in a reconciliation task:

  1. Under the relevant field in the left-pane, click Select Table.
  2. In the Select Table Data window, review the table to determine if the document extraction service identified it correctly.
  3. If the table, its rows, or its columns weren't correctly identified, move your cursor to the top left boundary of the table.
  4. Press and hold the Shift key and click and drag your cursor across the table to cover the entire table area.
  5. When you reach the lower right boundary of the table area, release your mouse and the Shift key.
  6. Click NEXT. If you can't click the NEXT button, a valid table wasn't detected. Try re-selecting the table area.
images/doc_extraction/draw-manual-table.gif

Review the updated data:

  1. Select whether the Table has column headers or the Table does not have headers.
  2. Confirm the data extracted from the table is correct. If it's not, choose which field in each column header corresponds to the column in the table.
  3. Remove rows that don't contain actual table data.
  4. Verify your data is correct.
  5. Click OK.

Learned mappings across environments

Whenever you complete a reconciliation task, Appian learns more about how extracted data maps to your data types. Depending on how you use document extraction in Appian, this learning may be deployed alongside design objects or you may need to complete reconciliation tasks in the target environment for Appian to learn about that data separately.

If you use the document extraction AI skill to extract data from documents, extraction mappings are associated with the AI skill object. When you deploy the AI skill to other environments, the learned mappings go with it. This means that you can complete reconciliation tasks in lower environments, and Appian is able to use that learning when you deploy the AI skill to production.

If you use document extraction functions and smart services, learning happens independently in each environment. When deploying your application to another environment, you may see different behavior for auto-extraction depending on which documents have been processed and how they have been reconciled by users.

Feedback