Dialogflow CX: Annotation Warnings remain even when the annotation is removed?

Hi,

I’m following a Google Code Labs to learn more about Dialogflow CX - this one:
https://codelabs.developers.google.com/codelabs/dialogflow-cx-retail-agent?hl=en#0

After creating the entities and intents as required for the lab, I noticed it didn’t seem to auto-annotate entities at all, so I made some manual annotations. I went a bit too far and annotated some parts of the training phrase that weren’t actually a match for the entity, e..g in the screenhot I tried to manually annotate ‘product’ as a custom entity called merch in the third training phrase.

This then gave an annotation warning - as per the second screenshot.

I went back in and removed the manual annotations the warnings were complaining about, but the warning is still there as per the screenshot.
How do I clear them? Do I need to in some way ‘force’ the NLU to reingest those training phrases to clear the warnings?

Secondly, will these warning actually affect the behaviour of the agent? I assume they do, as some intent routes are not working and they match up with the intents I have these annotation warnings for.

I eventually needed to delete and recreate the intent to clear the warning.
I first tried deleting and reimporting all the training phrases, but that didn’t work.

I’m still unclear as to the impact of this type of warning on the agent.

It turned out these warnings were not the reason I was getting errors when testing a route with that intent. That was due to a typo I had in a condition route elsewhere in that flow.

Hi @JoeMcFadden,

Welcome to Google Cloud Community!

It’s good that you identified the root cause of your routing errors. This underscores the necessity of thoroughly examining all facets of your agent, from intent definitions to routing conditions, when diagnosing issues.

Regarding the impact of the warnings on agent behaviour:

Yes, the warnings can definitely impact the agent’s behaviour. When there are inconsistencies between your annotations and the actual data, it can lead to:

  • Incorrect intent matching: The agent may not correctly identify the user’s intent due to the mismatched annotations.
  • Incorrect entity extraction: The agent may not extract the relevant entities from the user’s input, leading to incorrect responses.

Here are the key takeaways:

  • Annotation warnings are not always directly accountable for routing errors. While they may indicate inconsistencies that could affect agent performance, they do not necessarily result in immediate failures.
  • Deleting and recreating the intent often resolves the warnings. Although this is a workaround, it can be effective when simpler methods fail.
  • A careful review of all agent components is vital. Small issues, such as typos in conditions and incorrect entity definitions, can significantly impact routing and agent behavior.

I recommend consulting the general agent design best practices for further guidance.

I hope the above information is helpful.