Generative AI Skills

Overview

This topic describes AI skills that use generative AI to automate many common tasks in your business processes.

Generative AI skills handle document digitization, even for scanned or image-based content. They support file types like JPEG, PNG, TIFF, and PDFs, and automatically apply Optical Character Recognition (OCR) to extract text for seamless processing.

What is generative AI?

Generative AI models create new content. Generative models take a prompt as input (such as a question or request). As the model evaluates that request, it recalls what it knows about those characteristics. As it begins to formulate a response, it uses probability to determine what comes next.

The output is entirely new content. Rather than regurgitating information word-for-word, generative models can formulate more specific answers, crafted just for that prompt. Examples of generative models include chat bots and image generators.

When to use generative AI

Generative AI is very flexible, so you can use it in multiple ways in your Appian processes. You can use generative AI to summarize content, extract information you're interested in, and detect sensitive information. You can even specify how you want those results to appear: in code, a paragraph, or a bulleted list.

Here are a few examples of when to use generative AI in Appian:

If you want to…	Use…
Quickly determine whether a form submission is a support request or a general inquiry	Text classification or unstructured email classification
Extract essential details of a legal document, such as a contract	Unstructured document extraction
Summarize action items and assignments in a meeting transcript	Text extraction
Identify sensitive, legally protected information in a portfolio of medical documents	PII extraction from documents
Evaluate if your business is a good fit for a contract opportunity	Document summarization
Create content for a new product launch, in line with your business's branding	Text generation

See below to learn more about when to use generative AI or Advanced IDP Tools for document extraction.

AI Skills using generative AI

All generative AI skills create a prompt builder AI skill with a pre-populated template based on your use case. You can adjust the prompt, control the temperature, provide examples, and test the prompt directly within the AI skill.

If you don't see an AI skill suited to your use case, you can always use the Prompt Builder. Use this skill to create a prompt to send to generative AI models. You'll tell the model what you want it to do using plain language. After adjusting a few settings and testing the prompt, you can see what the model returns based on your instructions. Use this skill to summarize long or complex text, generate new content, and more!

Classification

• Text: Identify text based on certain traits. You'll tell us about the types of text you want to classify in your business process and provide samples of each type.

Extraction

• Text or Emails: Extract data from text or emails. You'll tell us what you want to extract and how you want that information to appear in the output.
• Documents: Extract data from a document.
  • Unstructured: You'll tell us what you want to extract from an unstructured document and how you want that information to appear in the output. For example, this skill can help you extract data from large or free-flowing paragraphs of text, like contracts or from visual elements like checkboxes, charts, or images.

Generation

• Text: Create text for any purpose. You'll tell us what text you want to generate and whether you want the output to include any specific logic, format, or other requirements.

Summarization

• Text, Email Text, or Document Text: Summarize text from any source, including emails and documents. You'll tell us what you want to summarize and how you want the summary to appear.

PII Detection

• Text, Email Text, or Document Text: Extract personally identifiable information (PII) in a document, email, or text block. You'll tell us the personally identifiable information (PII) you want to extract, such as names or phone numbers.

Usage considerations

What makes a good prompt?

In the context of AI, a prompt is how we communicate with the large language model (LLM) about what we want it to do. A well crafted prompt can help you communicate with the model more effectively, and reduce the amount of time you spend tweaking or troubleshooting.

Learn how to write an effective prompt on the AI Skills Best Practices page.

File types

In addition to PDFs, generative AI skills also accept JPEG, PNG, and TIFF files as direct inputs. The way these files are processed depends on the option you select for the AI Skill. If the skill is set to Text only, only the text content is analyzed. If it's set to Visual elements & text, the skill will also analyze the visual elements of the document.

Different requirements apply for each input type:

• Text: Only plain text is supported for text input, so file size, page count, and image limits do not apply.
• Email: EML files are supported with a maximum file size of 25 MB. Page and image size limits do not apply.
• Document: See the following table for the Document input type requirements.

Document input type requirements

File Type	Mode	Max File Size	Page Limit	Max Image Size
PDF	Text only	25 MB	100 pages	N/A
	Visual elements & text	25 MB	20 pages	N/A
JPEG, PNG	Text only	10 MB	N/A	10k x 10k pixels
	Visual elements F	3.75 MB	N/A	8k x 8k pixels
TIFF (single-page)	Text only	10 MB	1 page	10k x 10k pixels
	Visual elements & text	3.75 MB	1 page	4k x 4k pixels
TIFF (multi-page)	Text only	10 MB	100 pages	4k x 4k pixels
	Visual elements & text	18 MB (3.75 MB per page)	20 pages	4k x 4k pixels

Language support

Regional availability for the Visual elements & text option

To use generative AI skills with the Visual elements & text option enabled, you may need to configure an inference profile. If you're using an older model that doesn't use inference profiles, contact Appian Support to use this feature by sending your data to a supported region.

AI models

AI models are managed by system administrators in the Appian Administration Console. These settings control which large language models are available for use in Appian AI capabilities.

Developers select the model to use in their AI skills from the models enabled in their environment.

Model selection determines which generative AI model an AI skill uses to process prompts or documents. Each model offers different strengths. Some models prioritize speed, while others provide more advanced reasoning. Choosing the right model helps tailor your AI skill to your application's performance and accuracy needs.

You also select the model directly in the AI skill design object. From there, you can view all models available in your environment and choose the one that best fits your use case. You may see additional models in the AI skill object that do not appear on the AI Services page. These models are automatically enabled in your environment and don't require any configuration on the AI Services page.

For detailed configuration information, see the AI Services page.

Categories

Models are organized into two categories: Fast Models and Reasoning Models. Choosing the right model depends on the complexity of your task.

• Fast Models: These models are optimized for speed and are ideal for simple, high-volume tasks that require quick responses.
• Reasoning Models: These models are more powerful and are designed for complex tasks that require advanced reasoning, such as analyzing intricate documents or solving multi-step problems. Using these models may result in higher accuracy but longer processing times.

Availability

The available models depend on the configurations set in the AI Services page of the Admin Console and the region your environment is in. Due to this, you may see a different list of models in your development environment than in your production environment.

The list of available models also changes depending on the AI skill's document processing mode. Haiku 3 supports text extraction only and does not include vision-based capabilities.

Selection considerations

Use these considerations to understand how model selection behaves across environments and what to expect when managing AI skills.

• Administration: There is currently no administrative capability to restrict which models developers can select.
• Import and export: Before importing an AI skill, make sure the appropriate generative AI model is enabled in the target environment. Appian does not validate the model until the AI skill runs.
• Model deprecation: If a selected model is deprecated or disabled by an administrator, the AI skill execution will fail.
• Model selection: Select the latest available model. These models offer the best performance according to industry benchmarks.

How to select a model

Model selection gives you a clear view of the generative AI models available for your AI Skills. The model your AI Skill is currently using won't change unless you manually select a new model and save your changes.

You can select a model when configuring the AI skill.

When configuring an AI skill

When you create or edit an AI skill, you can select a model.

To select a model when you configure an AI skill:

1. In your application, open an existing AI skill or create a new one.
2. Open the Settings pane.
3. Under Model Selection, click the dropdown to see a list of available models.
4. Choose a model from the list. The list may include tags like New or Legacy to help guide your choice. The default model when you create a new AI skill is the recommended model.

Document extraction: Generative AI or Advanced IDP Tools?

When you extract data from documents, you can choose from different AI skills based on your document structure and extraction goals. Each AI skill is designed to handle specific scenarios and can be used individually or together for more accurate results.

This section explains the difference between Appian's two main document processing options and provides patterns to help you decide which is best for your use case.

• Advanced IDP Skill is a high-precision document recognition engine. It excels at identifying the text, layout, and visual elements in a document.
• Generative AI Skill is a reasoning engine. It excels at understanding the context of the text to answer questions and extract information.

When you create a document extraction model in DocCenter you can combine these AI skills by selecting the Advanced Layout option.

How Advanced IDP and Generative AI skills differ

Think of the Advanced IDP Tools skill as the tool that reads the document and the Generative AI skill as the tool that understands it.

When you send a document directly to a generative AI skill as a Text only document type, Appian performs a standard optical character recognition (OCR) step to read the text. For more complex documents, you can use the Advanced IDP skill first to perform a more detailed reading of the document's structure and content, then send that detailed map to the Generative AI skill for a more accurate analysis.

The table below summarizes the key differences.

Feature	Advanced IDP skill (The "Reader")	Generative AI skill (The "Thinker")
Primary Job	To perform high-precision OCR, converting a document image into structured text and layout data.	To understand, reason about, and generate content based on text input.
Strengths	Positional Awareness: Knows the exact coordinates of every word. Required for highlighting extracted data, detecting signatures, and extracting data from fixed forms.	Contextual Understanding: Can interpret nuanced language, infer meaning, and follow complex instructions to extract data from unstructured paragraphs.
Output	A structured map of located text, tables, and form elements with confidence scores.	New, generated text, typically in a structured JSON format as requested in the prompt.

Choosing the right pattern for document extraction

Your document's complexity and your business needs determine the best way to configure document extraction. This section describes three common patterns.

• Use only Generative AI skill
• Use only Advanced IDP skill
• Use Advanced IDP skill with Generative AI skill

Use only Generative AI skill

This approach is best for simple, text-heavy documents where the visual layout is not important. By passing the document directly to the Execute Generative AI Skill smart service, you use the simple, built-in OCR to retrieve the text.

Use this pattern for documents like:

• Emails
• Transcripts
• Simple letters

Use only Advanced IDP Tools skill

For some use cases, you don't need the Generative AI skill's reasoning capabilities. The Advanced IDP Tools skill is effective on its own for tasks that depend on a document's structure. To use this pattern, create an Advanced IDP Tools AI Skill and call it using the Advanced IDP Tools smart service in a process model.

Use this pattern to:

• Index documents for search: Use the Text tool to extract all content from a set of documents and write it to a database field that is enabled for smart search.
• Verify signatures or checkboxes: Use the Signatures or Checkboxes tool to confirm if a document is signed or which options are selected.
• Extract from fixed forms: For highly structured documents that never change like certain government forms.
• Leverage Confidence Scores: Use the confidence scores returned by the AI skill to support automated decisions, such as straight-through processing, when the score exceeds a defined threshold.

Use Advanced IDP Tools skill with Generative AI skill

This is the most robust pattern, designed for complex or semi-structured documents where you need both high-precision OCR and intelligent reasoning. To use this pattern, select Advanced Layout when you configure your document extraction model in AI Document Center.

Use this pattern for documents like:

• Invoices with varying formats
• Complex contracts
• Utility bills

How it works

When you use the Advanced Layout option, the extraction process happens in two steps:

1. Advanced IDP Tools skill scans the document to create a detailed, structured map of all its content, including checkboxes, tables, and signatures. Appian then automatically formats this map into a clearly structured phrase that AI can understand more easily.
2. Generative AI skill receives the formatted text from the first step. Your prompt then guides the model to reason over this high-quality text to find and extract the data you need.

Highlighting extracted data

When you enable the Bounding option in a document extraction model, Appian uses the x- and y-coordinate data from the Advanced IDP Tools skill. This allows you to show users exactly where on the page each piece of data was found on the reconciliation task interface.

AI action usage consideration

This combined pattern provides the highest accuracy but also uses more AI actions than other patterns. Converting the detailed structural data from the Advanced IDP Tools skill into a formatted text string can result in a large input for the generative AI skill. However, the improved accuracy often outweighs the additional AI action cost.

Feedback