Option to disable async pattern added to Web activity #20
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
ADF now has an option to disable async pattern on Web activity which allows for retrieving the Location (URL for getting the status of the refreshId associated with the POST call) in the ADFWebActivityResponseHeaders. This is a nice improvement as we can now call that directly inside the While loop's GetAzureASRefreshStatus activity. https://techcommunity.microsoft.com/t5/azure-data-factory/adf-web-activity-missing-response-headers/m-p/2709492
ADF web activity now as an option to disable async pattern which allows for getting the Location (URL for retrieving the status of the refreshId associated with the POST call) directly in the ADFWebActivityResponseHeaders of the response. This is nice because it can be used directly in the GetAzureASRefreshStatus activity within the While loop. https://techcommunity.microsoft.com/t5/azure-data-factory/adf-web-activity-missing-response-headers/m-p/2709492
Owner
|
Great find @SeanPhillips22 ! I had missed the announcement of this feature even though it was 2 years ago! it looks like you updated the ProcessAzureAS.json file but added MSI auth. Maybe you meant to update the ProcessAzureAS MSI.json file instead? If you could make this update that would be great. I will plan to test this out when I have time and merge if all looks good. Thanks so much for your contribution!! |
Author
|
@furmangg should be good now. ProcessAzureAS MSI.json is the updated file. Reverted ProcessAzureAS to match master branch. Let me know if it still doesn't seem correct. Thanks! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
ADF web activity now as an option to disable async pattern which allows for using the Location (URL for retrieving the status of the refreshId associated with the POST call) from within the ADFWebActivityResponseHeaders of the StartProcessingAzureAS's response.
The Location can then be used as the URL for the GetAzureASRefreshStatus activity within the While loop as the URL.
This eliminates the need for the GetAzureASRefreshes and FilterToCurrentRefresh activities and eliminates any complications if multiple refreshes had started within the last 30 seconds. (basically we always get the correct refreshId)
Reference:
https://techcommunity.microsoft.com/t5/azure-data-factory/adf-web-activity-missing-response-headers/m-p/2709492