Back to blog
Browse by tag
decision-replay
2 posts
The Decisions API Returned 0.62. Now What?
A 0.62 from OpenAI's Decisions API is an estimate, and both OpenAI and TypeSafe, which makes a similar model called Jev, leave the action to your application. Keep the threshold in a business rule that also reads the refund amount and the customer's refund history, and store the number with each decision so a new threshold can be tested without asking the model again.
November 1, 202623 min read
Decision Replay or Impact Simulation: What to Compare a Rule Change Against
Impact Simulation compares two rule versions on the same inputs. Decision Replay compares a candidate version with the decisions customers actually got. On one day of card transactions they gave different counts, and both were right.
October 23, 202611 min read