Overview of Exchange 2013 Architecture Transport components shipping

Overview of Exchange 2013 Architecture Transport components shipping with Exchange 2013 Mail Routing Scenarios Transport High Availability SMTP Client Submission

CAS HUB DAG MBX UM Auth; Proxy; Redirect Protocols; API; Biz. Logic

CAS HUB DAG UM Auth; Proxy; Redirect Protocols; API; Biz. Logic CAS DAG HUB* UM MBX Auth; Proxy; Redirect Server Prot* MBX Server Protocols; API; Biz. Logic

Internet HUB MBX Site Boundary DAG

Internet HUB MBX Site Boundary DAG

Internet HUB MBX Site Boundary DAG

Internet HUB MBX Site Boundary DAG

Internet HUB MBX Site Boundary DAG

Internet HUB MBX Site Boundary DAG

Internet HUB CAS DAG MBX Site Boundary DAG Frontend CAS Transport Mailbox Transport MBX Frontend Transport Site Boundary HUB Internet Mailbox Transport

Internet HUB CAS DAG MBX Site Boundary DAG Frontend CAS Transport Mailbox Transport MBX Frontend Transport Site Boundary HUB Internet Mailbox Transport

Internet HUB CAS DAG MBX Site Boundary DAG Frontend CAS Transport Mailbox Transport MBX Frontend Transport Site Boundary HUB Internet Mailbox Transport

Internet HUB CAS DAG MBX Site Boundary DAG Frontend CAS Transport Mailbox Transport MBX Frontend Transport Site Boundary HUB Internet Mailbox Transport

Internet HUB CAS DAG MBX Site Boundary DAG Frontend CAS Transport Mailbox Transport MBX Frontend Transport Site Boundary HUB Internet Mailbox Transport

Internet HUB CAS DAG MBX Site Boundary DAG Frontend CAS Transport Mailbox Transport MBX Frontend Transport Site Boundary HUB Internet Mailbox Transport

Internet HUB CAS DAG MBX Site Boundary DAG Frontend CAS Transport Mailbox Transport MBX Frontend Transport Site Boundary HUB Internet Mailbox Transport

Internet HUB DAG HUB Sub MBX Sub

Internet HUB DAG HUB Sub MBX Sub

Internet HUB DAG HUB Sub MBX Sub

Internet HUB DAG Internet HUB Sub MBX Sub CAS DAG Frontend CAS Frontend Transport Mailbox Transport MBX

Internet HUB DAG Internet HUB Sub MBX Sub CAS DAG Frontend CAS Frontend Transport Mailbox Transport MBX

Internet HUB DAG Internet HUB Sub MBX Sub CAS DAG Frontend CAS Frontend Transport Mailbox Transport MBX

Internet HUB DAG Internet HUB Sub MBX Sub CAS DAG Frontend CAS Frontend Transport Mailbox Transport MBX

2 Building Blocks • Evolution of E 2010 CAS Array • Now includes SMTP Frontend Transport • Primary function is to get the client to the right MBX server Mailbox Server Role • Now includes all core messaging protocols • Now includes Transport and Mailbox Transport (Delivery & Submission) Exchange Online Protection External SMTP servers MBX Frontend Transport CAS CAS AD MBX DAG 3 CAS Mobile phone Transport MBX Mailbox Transport DAG 2 MBX MBX Web browser Outlook (remote user) DAG 1 CAS Array Layer 4 LB Client Access Server (CAS) Role Enterprise Network Outlook (local user) MBX

1. Email enters the organization Enterprise Network External SMTP servers CAS CAS Web browser Outlook (local user) DAG 3 CAS Mobile phone Outlook (remote user) AD CAS Array Layer 4 LB Exchange Online Protection 1 DAG 2

1. Email enters the organization Exchange Online Protection External SMTP servers 1 AD CAS 2 CAS Web browser Outlook (local user) DAG 3 CAS Mobile phone Outlook (remote user) DAG 1 CAS Array Layer 4 LB 2. Frontend Transport running on CAS server accepts the mail Enterprise Network DAG 2

1. Email enters the organization 3. Frontend Transport determines DAG for this recipient Exchange Online Protection External SMTP servers 1 AD 3 CAS 2 CAS Web browser Outlook (local user) DAG 3 CAS Mobile phone Outlook (remote user) DAG 1 CAS Array Layer 4 LB 2. Frontend Transport running on CAS server accepts the mail Enterprise Network DAG 2

1. Email enters the organization 3. Frontend Transport determines DAG for this recipient 4. CAS sends mail to a MBX server in the recipients DAG [prefers MBX server in its own site] Exchange Online Protection External SMTP servers 1 AD 3 CAS 2 CAS DAG 3 CAS CAS Mobile phone MBX DAG 2 4 MBX Web browser Outlook (remote user) DAG 1 CAS Array Layer 4 LB 2. Frontend Transport running on CAS server accepts the mail Enterprise Network Outlook (local user)

mailbox client access mailbox

2 Building Blocks • Evolution of E 2010 CAS Array • Now includes SMTP Frontend Transport • Primary function is to get the client to the right MBX server Mailbox Server Role • Now includes all core messaging protocols • Now includes Transport and Mailbox Transport (Delivery & Submission) Exchange Online Protection External SMTP servers CAS Array Frontend Transport Layer 4 LB Client Access Server (CAS) Role Enterprise Network AD MBX DAG 3 CAS MBX CAS DAG 2 MBX MBX MBX Web browser Outlook (remote user) MBX CAS Mobile phone DAG 1 Outlook (local user) MBX

Handles inbound and outbound external SMTP traffic Authenticated SMTP Anonymous SMTP (Does not replace the Edge Transport Server Role) Handles authenticated client submissions Functions as a layer 7 proxy and has full access to protocol conversation (inbound) Will not queue or bifurcate mail locally All outbound traffic to next hop appears to come from the CAS 2013 Listens on TCP 25 and TCP 587 and TCP 717 External SMTP Frontend Transport SMTP Receive Protocol Agents SMTP Send Mailbox Selector MSExchange. Frontend. Transport. exe SMTP from MBX 2013 SMTP to MBX 2013

2 Building Blocks • Evolution of E 2010 CAS Array • Now includes SMTP Frontend Transport • Primary function is to get the client to the right MBX server External SMTP servers Mailbox Server Role • Now includes all core messaging protocols • Now includes Transport and Mailbox Transport (Delivery & Submission) CAS Array Exchange Online Protection CAS Layer 4 LB Client Access Server (CAS) Role Enterprise Network *previously known as Hub Transport AD Transport DAG 3 CAS MBX CAS DAG 2 Transport MBX Web browser Outlook (remote user) MBX CAS Mobile phone DAG 1 Outlook (local user) MBX

Processes all SMTP mail flow for the organization Will queue and route messages in and out of the organization SMTP from CAS SMTP to CAS, MBX, HUB Transport SMTP Receive Protocol Agents Performs content inspection Submission Queue SMTP Send Categorizer Delivery Queue Routing Agents Supports extensibility in SMTP and categorizer Listens on TCP 25 (or TCP 2525 when co-located with CAS) *previously known as Hub Transport Pickup/Replay Delivery Agents Mail. que Delivery Queue Edgetransport. exe SMTP from MBX-Transport Submission *other protocols SMTP to MBX-Transport Delivery

On Submitted SMTP Receive On Resolved On Routed On Categorized External Delivery Queue Protocol Agents Resolve Recipients Submission Queue Mail. que Find Route for Recipient Categorizer Content Conversion & Bifurcation Internal Delivery Queue Mailbox Delivery Queue SMTP Send

2 Building Blocks • Evolution of E 2010 CAS Array • Now includes SMTP Frontend Transport • Primary function is to get the client to the right MBX server Mailbox Server Role • Now includes all core messaging protocols • Now includes Transport and Mailbox Transport (Delivery & Submission) CAS Array Exchange Online Protection External SMTP servers CAS Layer 4 LB Client Access Server (CAS) Role Enterprise Network Outlook (local user) AD Mailbox Transport DAG 3 CAS MBX CAS DAG 2 MBX Mailbox Transport MBX Web browser Outlook (remote user) MBX CAS Mobile phone DAG 1 MBX Mailbox Transport

Handles mail submission and delivery from/to Store using two separate processes Does not have persistent storage Performs MIME to MAPI conversion (and vice versa) Combines Mailbox Assistant and Store Driver functionality (Supports all E 2010 store driver extensibility events) Leverages local RPC for delivery to and submission from Store Does not support any extensibility SMTP from Transport SMTP to Transport Mailbox Transport SMTP Receive SMTP Send Delivery Submission Deliver Agents Mailbox Assistants Submit Agents MSExchange. Submission. exe MSExchange. Delivery. exe MAPI Store

Enterprise Network CAS Array Exchange Online Protection Layer 4 LB External SMTP servers CAS AD MBX DAG 3 CAS MBX CAS DAG 2 MBX MBX MBX Web browser Outlook (remote user) MBX CAS Mobile phone DAG 1 Outlook (local user) MBX

Edge Transport 2013 Ships in SP 1 Same feature set as Edge role in 2010 New monitoring framework (like rest of Exchange 2013) No AV; basic Antispam features; No Shadow copy Client submission still works via CAS DAG 1 MBX Exchange Online Protection CAS Array MBX DAG 3 CAS External SMTP servers MBX Mobile phone CAS Web browser CAS Outlook (local user) MBX CAS Outlook (remote user) AD Edge Transport Layer 4 LB Used in perimeter network (non-domain joined) to accept mail Enterprise Network DAG 2 MBX MBX MBX

• • Scenario 1 – Incoming mail on a multi-role server Scenario 2 – Incoming mail to two recipients Scenario 3 – Originating mail to Internet Scenario 4 – Originating mail to multiple recipients

Frontend Transport receives message on port 25 . . . looks up where recipient’s mailbox exists and routes to a Transport service within the DAG for that mailbox Transport receives message on port 2525 … processes it and routes it to mailbox transport delivery on server where mailbox is active Mailbox Transport Delivery receives the message on port 475 … converts MIME to MAPI and delivers message to Store. Internet DAG Server CAS 2013 Frontend Transport MBX 2013 Transport Mailbox Transport Store

EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK DATA Internet Frontend Transport

EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK (TLS Session) EHLO 250 OK (EXCHANGEAUTH) DATA XPROXYFROM 250 OK MAIL FROM 250 OK Internet Frontend Transport RCPT TO 250 OK DATA 250 OK Transport

EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK (TLS Session) EHLO 250 OK (EXCHANGEAUTH) DATA XPROXYFROM 250 OK MAIL FROM 250 OK Frontend Transport Internet 250 OK QUIT RCPT TO 250 OK DATA 250 OK Transport

EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK (TLS Session) EHLO 250 OK (EXCHANGEAUTH) DATA XPROXYFROM 250 OK MAIL FROM 250 OK Frontend Transport Internet 250 OK QUIT RCPT TO 250 OK DATA 250 OK QUIT Transport

Mailbox Transport (TLS Session) EHLO 250 OK (EXCHANGEAUTH) XSESSIONSPARAMS 250 OK MAIL FROM 250 OK RCPT TO 250 OK DATA 250 OK QUIT

EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK (TLS Session) EHLO 250 OK (EXCHANGEAUTH) DATA XPROXYFROM 250 OK MAIL FROM 250 OK Frontend Transport Internet 250 OK QUIT RCPT TO 250 OK Mailbox Transport DATA 250 OK QUIT (TLS Session) EHLO 250 OK (EXCHANGEAUTH) XSESSIONSPARAMS 250 OK MAIL FROM 250 OK RCPT TO 250 OK DATA 250 OK QUIT

Received: from EXHV-1889. EXHV-5245 dom. extest. microsoft. com (2001: 4898: e 8: 3050: d 9 f 3: 8 ace: 7 a 2 f: 900 b) by EXHV-1889. EXHV-5245 dom. extest. microsoft. com (2001: 4898: e 8: 3050: d 9 f 3: 8 ace: 7 a 2 f: 900 b) with Microsoft SMTP Server (TLS) id 15. 0. 620. 3 via Mailbox Transport; Sun, 27 Jan 2013 11: 50: 14 -0800 Received: from EXHV-1889. EXHV-5245 dom. extest. microsoft. com (2001: 4898: e 8: 3050: d 9 f 3: 8 ace: 7 a 2 f: 900 b) by EXHV-1889. EXHV-5245 dom. extest. microsoft. com (2001: 4898: e 8: 3050: d 9 f 3: 8 ace: 7 a 2 f: 900 b) with Microsoft SMTP Server (TLS) id 15. 0. 620. 3; Sun, 27 Jan 2013 11: 50: 13 -0800 Received: from Internet (172. 18. 140. 30) by EXHV-1889. EXHV-5245 dom. extest. microsoft. com (10. 176. 198. 88) with Microsoft SMTP Server (TLS) id 15. 0. 620. 3 via Frontend Transport; Sun, 27 Jan 2013 11: 50: 10 -0800 Subject: Incoming mail on all-in-one role Message-ID: <0 eecd 3 ae-f 179 -4852 -bb 5 e-4 b 2 a 371 cbb 2 c@woodgrove. SVR 145. com> From: <internetuser@woodgrove. com>

Internet CAS 2013 2 Recipients CAS 2013 Frontend Transport DAG MBX 2013 Mailbox Transport Store Transport Site Boundary Transport Mailbox Transport Store Site

Internet CAS 2013 Frontend Transport DAG MBX 2013 Transport Mailbox Transport Store Site

(TLS Session) EHLO 250 OK (EXCHANGEAUTH) MAIL FROM 250 OK RCPT TO 250 OK DATA 250 OK Transport QUIT Mailbox Transport

Internet EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK DATA 250 OK QUIT Frontend Transport (TLS Session) XPROXYTO 250 OK MAIL FROM 250 OK RCPT TO 250 OK DATA 250 OK QUIT Transport

(TLS Session) EHLO 250 OK (EXCHANGEAUTH) MAIL FROM 250 OK RCPT TO 250 OK DATA 250 OK Internet EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK DATA 250 OK QUIT Frontend Transport (TLS Session) XPROXYTO 250 OK MAIL FROM 250 OK RCPT TO 250 OK DATA 250 OK QUIT Transport QUIT Mailbox Transport

Internet CAS 2013 Frontend Transport DAG 1 DAG 2 MBX 2013 Mailbox Transport Store Site Boundary Transport 3 Recipients Frontend Transport MBX 2013 Transport Mailbox Transport Store Site

Shadow is done ONLY by the Transport service Every message is redundantly persisted (shadowed) before its receipt is acknowledged to the sender If shadow can’t be made, Transport service will reject sender with 450 4. 5. 1 response Transport service will first attempt to shadow to an active server in another site (but in the same DAG); after which will try to shadow to any active server in DAG Shadow server will periodically check with the primary server for a heartbeat; if no heartbeat for 3 hours, it will send message on behalf of primary Duplicate delivery detection present in store; in case primary resends message

Transport service redundantly store all mail for a configured time span to protect against irrecoverable mailbox failures Now has a “shadow” equivalent and is no longer a SPOF Consolidates and improves E 2010 Transport Dumpster functionality Processes replay requests by resubmitting messages from “primary” or “shadow” Safety Net for mailboxes fail overs or lag restores To see various shadow & safety net values: get-transportconfig | fl *Shadow*, *safety* [Shadow. Heartbeat. Frequency; Shadow. Resubmit. Time. Span; Safety. Net. Hold. Time]

Internet CAS 2013 Frontend Transport DAG MBX 2013 Mailbox Transport Store SMTP Site Boundary Transport Mailbox Transport Store Site

EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK (TLS Session) EHLO 250 OK (EXCHANGEAUTH) DATA XPROXYFROM 250 OK MAIL FROM 250 OK Frontend Transport Internet 250 OK QUIT RCPT TO 250 OK DATA 250 OK QUIT Transport

EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK (TLS Session) EHLO 250 OK (EXCHANGEAUTH) DATA XPROXYFROM 250 OK MAIL FROM 250 OK Internet Frontend Transport RCPT TO 250 OK DATA Transport (MBX Svr 1)

EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK (TLS Session) EHLO 250 OK (EXCHANGEAUTH) DATA XPROXYFROM 250 OK MAIL FROM 250 OK Internet Frontend Transport RCPT TO 250 OK DATA Transport (MBX Svr 1) (TLS Session) EHLO (EXCHANGEAUTH) XSHADOWREQUEST MAIL FROM 250 OK RCPT TO 250 OK DATA 250 OK QUIT Transport (MBX Svr 2)

EHLO 250 OK MAIL FROM 250 OK RCPT TO 250 OK (TLS Session) EHLO 250 OK (EXCHANGEAUTH) DATA XPROXYFROM 250 OK MAIL FROM 250 OK Frontend Transport Internet RCPT TO 250 OK DATA Transport (MBX Svr 1) (TLS Session) EHLO (EXCHANGEAUTH) XSHADOWREQUEST MAIL FROM 250 OK RCPT TO 250 OK DATA 250 OK QUIT Transport (MBX Svr 2)

(TLS Session) EHLO (EXCHANGEAUTH) XSHADOW 250 OK XQDISCARD 250 OK (MSG ID) QUIT Transport (MBX Svr 2) Transport (MBX Svr 1) (TLS Session) EHLO (EXCHANGEAUTH) XSHADOW 250 OK XQDISCARD 250 OK (MSG ID) QUIT

mail. fabrikam. com CAS 2013 Frontend Transport DAG 2 Site 1 M 2 M 3 DAG 2 DAG 1 M 5 M 4 Site Boundary DAG 1 M 1 Frontend Transport Site 2 M 6 M 7 M 8

EHLO 250 OK (TLS Session) AUTH (TLS Session) XPROXY 250 OK MAIL FROM 250 OK RCPT TO SMTP Mail Client 250 OK DATA 250 OK QUIT Frontend Transport RCPT TO 250 OK DATA 250 OK QUIT Transport Mailbox Transport