Generative AI Client (Aspire 5.3 - TODO)

Welcome to the Generative AI Client workflow application. 

Generative AI client has been designed to allow running custom Groovy scripts. The scripts can do many different tasks but they are most useful when Generative AI services are needed to be called for crawled documents and the results from those calls are to be put in the document for later indexing. When writing Groovy scripts we can use so called binding variables to simplify AI related tasks:

• REST client comes configured with required authentication methods based on UI parameters
• REST client can be configured how to handle automatically typical throttling issues - like 429 errors
• Methods for creating POST body for typical AI tasks are present
• Methods for allowing REST calls for typical AI URLs are present
• The REST call response comes in typical fashion for easy parsing and using it in the document
• Support for general template scripts is here to allow selection of already prepared scripts with the support of template script properties
• If secret information must be used in Groovy script they can be defined in UI, stored as encrypted and use as automatically decrypted in the scripts
• Typical scenarios for running embeddings and prompts related tasks are built in and can be used with just several lines of Groovy script
• Support for different AI services providers is supported - we support Azure and Google Palm at the present version

Prerequisites

Requirements to use the Generative AI Client workflow application.

How to Configure 

Step-by-step tutorial on how to configure the Generative AI Client  workflow application.

Groovy scripts support

How to write AI related Groovy scripts