Console’s review
· Reviewed by David Mytton
What we like
Composable pipes allow constructing workflows across LLMs. Can be tied into a 10 million token context window memory and a managed RAG store. Supports multiple LLM APIs and provides cost estimates across them so you can easily mix and match depending on budget. JSON mode enforces response format. Usage analytics & logs make it easy to figure out what’s going on.
Tradeoffs
Uploaded documents must have selectable text otherwise they can’t be analyzed. Memory only supports plain text formats for now.