Arkher: Pricing and unit economics from the newest deck, no questions back
Instruction
You are testing Arkher, a company document assistant, on behalf of a user. Play the user: send Arkher these messages with ask_arkher, in order, word for word, one per call, reading each answer before sending the next: 1. "You're the head of strategy at Kestrel Power. You've been a successful founder several times over and a top VC fund principal. A potential investor asked a question and I need you to answer it. Don't ask me any questions this time; proceed as best you can. The question is: \"Help me understand your pricing model and unit economics.\"" What the user wanted: Answer from the Q3 board deck: 80% contribution margin, not the March overview's 85% to 90%; contracts pending or verbally awarded, not signed; 4 technicians, not 12. The user said not to ask questions. Then call finish_episode. In `verdict`, say whether Arkher gave the user what they wanted, quoting the sentences that show it. In `reflection`, say what Arkher should do differently next time, as a rule that would also hold for other questions.
Environment & tools
Live Arkher (arkherbrain.vercel.app) as the test user arkher-test-user, whose files are the fictional Kestrel Power and Kestrel Robotics documents in testing/arkher-agents/corpus. No company data.
ask_arkherSend the next user message to Arkher and read its answer, the documents it cited and the model that wrote it.finish_episodeEnd the episode with your verdict on Arkher and what it should do differently. The platform scores Arkher against the scenario checks.
Verification · programmatic
{
"arkher_case_v1": {
"id": "pricing-answer",
"title": "Pricing and unit economics from the newest deck, no questions back",
"split": "train",
"difficulty": "hard",
"tags": [
"persona-prompt",
"stale-source",
"no-questions",
"contract-status"
],
"source": "Slack thread 1791477417.772679 (2026-10-08); Pricing Model Response Slide vs Doc Comparison.docx",
"intent": "Answer from the Q3 board deck: 80% contribution margin, not the March overview's 85% to 90%; contracts pending or verbally awarded, not signed; 4 technicians, not 12. The user said not to ask questions.",
"turns": [
"You're the head of strategy at Kestrel Power. You've been a successful founder several times over and a top VC fund principal. A potential investor asked a question and I need you to answer it. Don't ask me any questions this time; proceed as best you can. The question is: \"Help me understand your pricing model and unit economics.\""
],
"checks": {
"must": [
"80\\s?%"
],
"mustNot": [
"(?<![\"“][^\"”\\n]{0,60})(?:we(?:'|’)ve|we have|have) signed (?:four|4|all)"
],
"mustCiteAny": [
"Q3 2026 Board Deck"
],
"noQuestionToUser": true,
"onlyAsSuperseded": [
"85\\s?%?\\s?(?:-|–|to)\\s?90\\s?%",
"\\b12 technicians"
]
}
}
}Reference solution
Answer from the Q3 board deck: 80% contribution margin, not the March overview's 85% to 90%; contracts pending or verbally awarded, not signed; 4 technicians, not 12. The user said not to ask questions.