cognify
Basic Information
Cognify is a developer-focused tool for automatically tuning, testing, and optimizing generative AI agents and workflow programs. It is designed to improve generation quality, reduce execution latency, and lower monetary cost for agents implemented with LangChain, LangGraph, DSPy, or Cognify's own Python workflow framework. The tool applies hierarchical, workflow-level optimization by experimenting with combinations of tuning methods across workflow components. Users run a simple CLI to optimize an agent source file and provide a configuration module that supplies a sample dataset, an evaluator for output quality, and optional optimization settings and model selections. Cognify iteratively evaluates candidate variations until a user-specified limit is reached and emits multiple optimized agent versions representing different quality, cost, and latency trade-offs on a Pareto frontier. The project includes installation via pip, documentation, a quickstart, and an API reference.