Lindy Community Icon

Understanding Evals in AI Agent Node Workflow

·
·

where do evals fit in for using the ai agent node?

  • is there a light eval as part of the loop in the node?

  • or is there a best practice for doing evals (ex. checking accuracy in knowledge base) after an ai agent node?

great write up here in your nov 2024 blog, but didn't help me understand how the ai agent node works out of the box. maybe im missing something

  • Avatar of Flo C.
    Flo C.
    ·
    ·

    hi! we don’t have evals yet as a first class citizen, but we’re thinking about it. in the meantime, we just recommend folks to test their lindies a lot. once we have looping (in 2 weeks) you’ll also be able to create a lindy that evals another lindy

  • Avatar of michael r.
    michael r.
    ·
    ·

    super helpful thank you! and looking forward to looping making lindy evals will be 🔥 🔥 🔥