INTEGRATE etc venues JUNE 3 5 2019 Wagner

INTEGRATE etc. venues, JUNE 3 - 5, 2019 Wagner Silveira Microsoft MVP - Azure Creating a Processing Pipeline with Azure Function and AIS London

• Principal Integration Architect • Microsoft Azure MVP • MCSE Cloud Platform About me wsilveiranz wagner. silveira@notetoself. tech https: //notetoself. tech

INTEGRATE etc. venues, JUNE 3 - 5, 2019 Agenda • • • Case Study Initial Solution Updated Solution Key Components A year later – what changed? • Lessons Learned London

Case Study

INTEGRATE etc. venues, JUNE 3 - 5, 2019 The solution requirements • Onboarding of external EDI messages • Should allow for different transports • Message need to be Validated, translated, enriched, routed • Control on retries and notification over failed messages • Auditing of initial message • Visibility of where a single message was in the process London

Logical Design

Initial Solution

INTEGRATE etc. venues, JUNE 3 - 5, 2019 Reality Check • Big Payloads • EDIFACT schema not available • Operational costs • End to end Monitoring London

Updated Solution

How was this different from the initial solution? • Azure Functions • EDIFACT support via. NET Package • Claim check pattern • Dedicated instances • Azure Storage • Payload storage (claim check pattern) • Application Insights • End to End with custom events • Single technology for monitoring and notification INTEGRATE etc. venues, JUNE 3 - 5, 2019 London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 Key Components London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 Key Components • Claim check pattern • App Insights Custom Events London

• Publishing function separates content from metadata then: • Store content on a safe repository • Publish metadata + storage pointer + Reprocessing count to message engine The claim check pattern • Subscribing processes receive metadata and retrieve content when required

INTEGRATE etc. venues, JUNE 3 - 5, 2019 App Insights custom events • End to end traceability using a Correlation ID • Allow for exceptions to be captured the same way • Leverage Functions support for App Insights • Implemented as a reusable component App Insights London

Hands on Time? INTEGRATE etc. venues, JUNE 3 - 5, 2019 London

Key Management • Leveraged MSI support where available • SQL Server • Storage • Key vault • Kept keys in key vault where MSI where not supported directly • Service Bus INTEGRATE etc. venues, JUNE 3 - 5, 2019 London

Exception Management & Retries on Functions • Catch blocks using a notify and throw pattern • Leverage Function SB binding peek-lock pattern • Adjusted Maximum Delivery Count on SB • Messages that failed where delivered to DLQ INTEGRATE etc. venues, JUNE 3 - 5, 2019 London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 DLQ Management • Logic Apps polling subscriptions DLQ every 6 hours • Each subscription DLQ could have it’s own logic • Reprocessing count • Resubmission logic • Notification logic • Email notification • Error blob storage London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 One year later… London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 New technology candidates • Integration Services Engine • Azure Durable Functions • Event Grid London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 What about new features • Azure Functions Premium • Improved support for Key Vault • Improved support for MSI • Virtual Network support + Service Endpoints London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 Lessons learned London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 Review the fine print London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 Operational cost is a design consideration London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 Make the best of each technology London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 Think about the big picture London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 In Summary • Weight your technology options • Think about limitations, operational costs • Understand how your solution fit in the big picture • Understand the components roadmap London

INTEGRATE etc. venues, JUNE 3 - 5, 2019 London