Released on July 24th, 2024

Tech Stack


  • Backend - API:
    • FastAPI: version 0.110.0
    • Python: 3.12.x for both Linux and Windows.
    • Elasticsearch: 8.12.x
    • Opensearch: 2.11.x
    • pyQPL: 1.1.6
    • OpenAI:
      • API version: 2024-03-01-preview
      • Models: gpt-4, gpt-4o.
      • Client Library: 4.14.1
    • tiktoken: 0.7.0
    • sentence-transformers: 2.7.0
  • Frontend:
    • React: 18.2.0
    • Redux: 5.0.1
    • Vite: 5.2.13
    • Axios: 1.6.8
    • Node: 20.11.1
    • Npm: 10.4.0 

Features

  • Backend
    • Support for Azure AI Search as a NoSQL provider.
      • Full-text search using Azure's adaptation of Lucene syntax (not comprehensive):
        • Wildcard searches.
        • Highlighting.
        • Autocomplete/typeahead.
        • Suggester.
        • Nested filtering (lists of filters).
        • Aggregations.
      • Support for Semantic and Hybrid search with Semantic Reranking.
      • Support for both API key and Managed ID authentication for Azure AI Search engine.
      • Configuration based on environment variables.
    • Creation of new GAIA Core library.
    • Added statistics for pipelines, stages, and endpoints.
    • New stages:
      • Basic Azure Group Expansion (filter search results based on security).
      • OpenAIToolDispatcher.
      • Send Email.
      • Sentence Splitter. 
      • Suggester.
      • Type Ahead.
    • New endpoint for the API:
      • Import/Export.
      • Statistics.
  • UI
    • Integrated AI Agent into the UI (formerly known as Chatty/Assistant).


Improvements

  • Backend:
    • Secured administrative endpoints.
    • New interceptor for the Analytics enpoint.
    • Improved the GET pipeline endpoint to return status of pipelines.
    • Support for latest Tools functionality in OpenAI GPT. 
    • Removal of confidential data from Debug stage.
    • Added the 'ignore_blanks' attribute for the Dynamic Results stage (ignores warnings when dynamic values are none). 
  • UI
    • Addition of Server-Sent Events (SSE) in the Agent to provide progress feedback to the user. 

Fixes

  • Backend:
    • General:
      • Swagger documentation page with unsafe-inline headers.
      • Fixed HTTP security headers being overwritten. 
      • Authentication methods not being loaded correctly when invoking the Config endpoint. 
      • Fixed issue when configuring a custom model in Calculate Vector Stage.
      • Fixed validation logic for authentication methods.
    • Documentation
      • Swagger documentationAnalytics and Feedback endpoints refering the former index name.  
  • UI:
    • General:
      • Logo link for Assistant redirecting to GAIA Search page. 
    • Aggregations:
      • Issues with the show less/more options for Term aggregations.
    • Dynamic Fields:
      • Text with Highlight not working properly when value is a list.
    • Histograms:
      • Some styles minor issues related to themes.
  • All third-party library vulnerabilities fixed.


Known Issues

  • Backend - API:
    • Azure AI Search as a NoSQL provider:
      • Azure does not support scroll search. Deep pagination can be achieved by combining top/skip arguments with range filters.
      • Azure does not support index templates.
      • Vector searches are performed through hybrid or semantic search.
      • Highlighting is not supported in hybrid search, only in semantic of full search.
      • Spell checking in Azure is done automatically when configured, with no feedback to the user. 
    • Dynamic Filter:
      • In nested aggregations, selecting a child value for a parent will select the same value in other parents.
      • Timezone not correctly handled in the DateTime field when using non-ISO dates.


Jira tickets detail:

GAIA UI here

GAIA API here


  • No labels