[BUG]The "follow-up tasks" in Azure AI Language Summarization is not working

[JohanKlijn]

Library name and version

Azure.AI.Language.Conversations 1.1.0

Describe the bug

When using the Azure AI Language Service to create a "recap and follow-up task summarization" accoording to this example: https://learn.microsoft.com/en-us/azure/ai-services/language-service/summarization/how-to/conversation-summarization#get-recap-and-follow-up-task-summarization I get the follwoing exception:

{
   "error": {
       "code": "InvalidRequest",
       "details": [
           {
               "code": "InvalidRequest",
               "message": "Job task: 'ConversationalSummarizationTask-summary_narrative' failed with validation error: Invalid value for parameter 'summaryAspects', valid values are issue, resolution, chapterTitle, narrative, recap."
           }
       ],
       "message": "Invalid Request.",
       "innererror": {
           "code": "InvalidParameterValue",
           "message": "Job task: 'ConversationalSummarizationTask-summary_narrative' failed with validation errors: ['Invalid parameter in request']"
       }
   }
}

So specifying a task with a summaryAspects of "follow-up tasks" doesn't work.

Example:

{
    "taskName": "Conversation Task 1",
    "kind": "ConversationalSummarizationTask",
    "parameters": {
        "summaryAspects": [
            "recap",
            "follow-up tasks"
        ]
    }
}

Expected behavior

follow-up tasks are created

Actual behavior

exception.

Reproduction Steps

Just use the example

Environment

.NET 8.0

[github-actions]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @quentinRobinson @wangyuantao.

[PooSham]

Any updates on this? Please either fix the bug or update the documentation. Preferably the former.

[ericrrichards]

This did usually work with the 2024-05-15-preview API version which is shortly going to be deprecated

Does not appear to work reliably anymore with the 2024-11-15-preview API version (current default/latest)

Usually results in the entire job failing with the error message follow-up tasks summarization failed.

{
  "DisplayName": null,
  "CreatedDateTime": "2025-03-06T14:49:10+00:00",
  "ExpirationDateTime": "2025-03-07T14:49:10+00:00",
  "JobId": "da74ead6-12d3-41e0-9cdd-13d2be850009",
  "LastUpdatedDateTime": "2025-03-06T14:49:30+00:00",
  "Status": {},
  "Errors": [],
  "NextLink": null,
  "Actions": {
    "Completed": 1,
    "Failed": 0,
    "InProgress": 0,
    "Total": 1,
    "Items": [
      {
        "Results": {
          "Conversations": [],
          "Errors": [
            {
              "Id": "f78d1eeb-f8a2-4283-9625-22f9131defcb",
              "Error": {
                "Code": {},
                "Message": "follow-up tasks summarization failed.",
                "Target": null,
                "Details": [],
                "Innererror": null
              }
            }
          ],
          "Statistics": null,
          "ModelVersion": "latest"
        },
        "LastUpdateDateTime": "2025-03-06T14:49:30.4441338+00:00",
        "Status": {},
        "Name": "Summarize Conversation"
      }
    ]
  },
  "Statistics": null
}

Splitting the follow-up tasks summarization job into a different action item from other summarization tasks will sometimes succeed, and sometimes will still fail.

Putting multiple summarization tasks into one action context seems to eat any errors details that occur, which can make it difficult to determine what the problem was.