Box 1: Cognitive Service User

Ensure that the members of a group named Management-Accountants can approve the FAQs.

Approve=publish.

Cognitive Service User (read/write/publish): API permissions: All access to Cognitive Services resource except for ability to:

1. Add new members to roles.

2. Create new resources.

Box 2: Cognitive Services QnA Maker Editor

Ensure that the members of a group named Consultant-Accountants can create and amend the FAQs.

QnA Maker Editor: API permissions:

1. Create KB API

2. Update KB API

3. Replace KB API

4. Replace Alterations

5. " Train API " [in new service model v5]

Box 3: Cognitive Services QnA Maker Read

Ensure that the members of a group named the Agent-CustomerServices can browse the FAQs.

QnA Maker Read: API Permissions:

1. Download KB API

2. List KBs for user API

3. Get Knowledge base details

4. Download Alterations

Generate Answer

The question is about evaluating a Custom Vision classifier after training.

When you train an image classifier in Azure Custom Vision, the service automatically calculates performance metrics to help you evaluate the quality of the model.

Metrics Provided by Custom Vision:

Precision:

The percentage of correct positive predictions out of all positive predictions made.

Formula: Precision = TP / (TP + FP)

Helps determine how reliable positive predictions are.

Recall:

The percentage of actual positives that were correctly predicted.

Formula: Recall = TP / (TP + FN)

Helps determine how many of the true positives were captured.

These two metrics are explicitly shown in the Custom Vision portal and via API.

Option Analysis

A. Recall

Yes, Custom Vision reports recall.

Correct

B. F-score

Not directly reported in the Custom Vision portal.

Although it can be derived from precision and recall, it is not provided as a direct metric.

Incorrect

C. Weighted accuracy

Not reported by Custom Vision.

Incorrect

D. Precision

Yes, Custom Vision reports precision.

Correct

E. Area under the curve (AUC)

Not reported by Custom Vision.

More common in ROC curve analysis, not part of Custom Vision output.

Incorrect

Correct Answer: A. recall, D. precision

Microsoft References

Evaluate the prediction performance of your classifier in Custom Vision

Custom Vision training and evaluation

A view is a virtual table based on the result set of a query.

Views allow you to encapsulate complex queries (including joins and calculated columns) and make them reusable by other users.

Index improves performance but does not store or rerun queries.

Scalar function returns a single value, not a tabular result.

Table stores raw data, not queries.