June 20: Support for LLM streaming in Typescript SDK, bug fixes

New Features

• 💡 Graphlit now supports LLM streaming natively in our Typescript SDK. Via streamAgent method in the SDK, you can prompt any LLM provider and receive a stream of token and tool calling events, which can be rendered into your application. Also, we support promptAgent for a similar DX with non-streaming support.

• We have added support for 'pull quotes' as a summarization type. You can have the LLM extract relevant, publishable quotes from any text or transcript.

Bugs Fixed

• GPLA-4327: formatConversation not adhering to 'None' search type

• GPLA-4340: Twitter messages should have default name

• GPLA-4334: Losing line breaks in markdown from ImageMezzanine