July 25: Support for Mistral Large 2 & Nemo, Groq Llama 3.1 models, bug fixes

💡 Graphlit now supports the Mistral Large 2 and Mistral Nemo models. The existing MISTRAL_LARGE model enum now will use Mistral Large 2.
💡 Graphlit now supports the Llama 3.1 8b, 70b and 405b models on Groq. (Note, these are rate-limited according to Groq's platform constraints.)
Added support for revision strategy on data extraction specifications. Now you can prompt the LLM to revise its previous data extraction response, similar to the existing completion revision strategy.
Added version property for AzureDocumentPreparationProperties type for assigning the API version used by Azure AI Document Intelligence. By default, Graphlit will continue to use the v4.0 (Preview) API version, but you can override this to assign version to V2023_10_31 to use the v3.1 (GA) API version instead. For some documents, the General Availability (GA) version of the API can provide better results.

Last updated 1 month ago