Exam AAIR Topic 1 Question 80 Discussion

Chatbot accuracy in customer service depends on correctly identifying customer intent and generating appropriate responses. Both intent classification accuracy and training data quality directly determine chatbot performance over time.
Why D is Correct: According to ISACA AAIR model performance management guidance, measuring intent- classification error rates provides precise diagnostic information about where the chatbot misunderstands customer inquiries, while refining training datasets based on those errors continuously improves classification accuracy. This closed-loop approach-measure specific errors, improve the underlying data that drives them- is the most effective mechanism for sustained high accuracy.
Why A is Wrong: Increasing model temperature increases output randomness and diversity, which is counterproductive for accuracy in customer service contexts where consistent, precise answers are required.
Precision and recall provide useful metrics but increased temperature actively undermines accuracy.
Why B is Wrong: Vendor benchmarking compares performance against generic standards. Customer service chatbots must be optimized for the specific organization's terminology, products, and customer base-generic thresholds may not capture the accuracy requirements of a specific deployment.
Why C is Wrong: Explainable AI techniques improve decision transparency but do not directly enhance classification accuracy. Code reviews address software quality, not the model's ability to accurately interpret customer intent.