Can you replace your AI provider?
Track 01 · Managers and Business Leads · English edition
What you will learn to do
verify the possibility of replacement for the complete service.
Fictional pedagogical case: a premium services company is preparing to automate its refunds.
The course
Management wishes to test another model. The provider indicates that the data is exportable. This possibility is useful, but it does not guarantee that the service will work elsewhere.
The system also depends on instructions, response formats, and application connections. One interface may expect specific fields. A tool may have been designed for a particular protocol. Validation rules may be hosted by the service provider.
Replacement must therefore be prepared as a system modification. The company inventories what it can recover and what it must rebuild. It examines contractual conditions and technical feasibility separately.
It then tests a sample of known cases, with expected results. Cases must include normal situations and possible errors. A cheaper model may require more verifications or produce a format incompatible with the execution tool.
Testing begins in an environment without real action. If the result is acceptable, the company can define the conditions for a progressive deployment and a rollback to the previous version.
The replacement criterion focuses on the task accomplished and its controls. A response that appears better is not enough to validate the service.
Your decision
The new provider produces better emails but does not systematically return the booking identifier. The generation cost decreases by 30%. The director wishes to activate automatic reimbursement. Write your decision in eight to ten lines and indicate the parts of the sheet to be revised.
Formulate an answer before opening the answer key.
Open the reasoned answer key
Automatic reimbursement must not be activated with this version if the reliable identifier is necessary to link the action to the correct case. The decrease in generation price does not compensate for the absence of this execution condition.
The new model can be tested for drafting in an appropriate scope. The team must correct the return of the identifier or provide this data through a reliable mechanism independent of the generation. It then verifies the misidentified cases and the associated execution attempts.
The sheet must be revised for components, tests, total cost, and the rollback procedure. The final decision depends on the results obtained on the corrected system.
Production to keep
replacement plan, acceptance criteria, and rollback conditions.
Evaluation criterion
Replacement is evaluated on the complete service.
Sources and references
The case and the answer key are VOCE pedagogical constructions; the references do not validate the effectiveness of this training.