arkher
Arkher: A productive back-and-forth: the follow-up builds on the first answer
v4You are testing Arkher, a company document assistant, on behalf of a user. Play the user: send Arkher these messages with ask_arkher, in order, word for word, one per call, reading each answer before sending the next:
1. "What does Kestrel Power charge per MW for PPM, and what can a site reach with the upside items?"
2. "So for a 150 MWdc site, what's the annual difference between the base and the upside price?"
What the user wanted: The second answer uses the first: it keeps the figures already given and works out the new ask instead of starting over or asking what 'that' means.
Then call finish_episode. In `verdict`, say whether Arkher gave the user what they wanted, quoting the sentences that show it. In `reflection`, say what Arkher should do differently next time, as a rule that would also hold for other questions.
mediumtrain2 toolsprogrammatic2 attempts · 100% pass