Problems and Solutions with Adabas Replication and Mass

Problems and Solutions with Adabas Replication and Mass Data Dieter W. Storr – www. storrconsulting. com 9 May 2011

Contents • • Mirroring and Replication Different Ways to Replicate Replication Scenario and Used Versions Replication Components and their Commands per Second Subscription DB: CPU Time With and Without Replication Batch Jobs: Duration With and Without Replication Buffers and Communication between Source DB and Reptor Challenges and Solutions 5/22/2021 | Software AG User Group 2011 | 2

The REPLICATOR Source: Bruno Bebert/DPA 5/22/2021 | Software AG User Group 2011 | 3

Mirroring and Replication Functions Mirroring Replication Copy tracks / blocks Yes No Repeat transactions No Yes Can target database be read during the copy/repeat process No Yes Will errors in tracks be copied? Yes No Can data / fields be selected? No Yes 5/22/2021 | Software AG User Group 2011 | 4

Type of Replication – Mainframe to Adabas on Mainframe 5/22/2021 | Software AG User Group 2011 | 5

Type of Replication – Mainframe to Adabas on LUW 5/22/2021 | Software AG User Group 2011 | 6

Type of Replication – Mainframe to non-Adabas 5/22/2021 | Software AG User Group 2011 | 7

Replication Scenario – Enterprise Server to Windows RPL V 3. 3. 1 ADA V 6. 2. 1 5/22/2021 | Software AG User Group 2011 | 8

Commands per Second During Replication 5/22/2021 | Software AG User Group 2011 | 9

Commands per Second During Replication 5/22/2021 | Software AG User Group 2011 | 10

CPU Time and Duration Prod DB ASSO DATA WORK 9 Batch Jobs Duration HH: MM Without RPL 02: 20 Prod DB CPU Time Per Week With 9 Jobs Running Without RPL 08: 39: 17 5/22/2021 | Software AG User Group 2011 | 11

CPU Time and Duration 9 Batch Jobs Duration HH: MM Without RPL 02: 20 With RPL – unchanged parms 13: 22 Reptor Prod DB ASSO DATA WORK Prod DB CPU Time Per Week With 9 Jobs Running w/o RPL 08: 39: 17 w/ RPL 17: 19: 59 SYS SLOG 5/22/2021 | Software AG User Group 2011 | 12

Duration of 9 Jobs 24 December 2010 12 January 2011 Without Replication With Replication Job 5031 5032 5033 5034 5035 5036 5037 5038 5039 From - To 19: 01 – 21: 00 19: 01 – 20: 58 19: 01 – 20: 57 19: 01 – 21: 06 19: 01 – 21: 21 19: 01 – 21: 18 19: 01 – 20: 59 19: 01 – 21: 00 TOT 19: 01 – 21: 21 Duration 1: 59 1: 57 1: 56 2: 05 2: 20 2: 17 1: 58 1: 59 From - To 19: 02 – 07: 27 19: 02 – 21: 38 19: 01 – 07: 11 19: 02 – 07: 58 19: 01 – 08: 22 19: 01 – 08: 23 19: 01 – 07: 29 19: 01 – 07: 30 19: 01 – 07: 33 2: 20 19: 01 – 08: 23 Duration 12: 25 2: 36 12: 10 12: 56 13: 21 13: 22 12: 28 12: 29 12: 32 13: 22 5/22/2021 | Software AG User Group 2011 | 13

Buffers and Communication Between Source and Reptor 5/22/2021 | Software AG User Group 2011 | 14

Buffer Usage During Replication 5/22/2021 | Software AG User Group 2011 | 15

Several Tests With 20% of Production Data Test Date # RPL LBP LFIOP LRPL in MG in MB ASYTVS FMXIO 9 Jobs Duration 1 01/27/2011 YES 70 13 500 YES 1 79 min 2 01/28/2011 NO 70 13 500 YES 1 40 min 3 01/31/2011 YES 150 13 500 YES 1 74 min 4 02/24/2011 YES 150 13 700 YES 8 61 min 5/22/2021 | Software AG User Group 2011 | 16

STROBE: Buffer Pool Manager – High CPU Time Source Database MODULE NAME. ADABAS. SVC. ADABAS. SUPERVS SECTION NAME ADANC 6 ADARPN SVC 114 ADANC 1 ADANC 8 ADANC 0 ADAIOS ADANC 5 ADANC 7 IGC 0024 A LINE NUMBER PROCEDURE/FUNCTION NAME ADANC 6 ADARPN ADANC 1 ADANC 8 STARTING LOCATION ADABAS BUFFER POOL MNGER ADABAS SYSTEM SERVICES EXCPVR ADABAS THREAD SELECTION ADABAS CMPRESS DVT HNDLR ADABAS USR/HYP EXIT CALL ADABAS I/O PROCESSING ADABAS QUEUE PROCESSING ADABAS FORMAT TRANSLATOR SUPERVISOR SERVICES PROCEDURE LENGTH CPU TIME SOLO 51. 49 12. 61. 05. 17. 11. 32. 21. 10. 03. 05 5/22/2021 | Software AG User Group 2011 | 17

STROBE: Buffer Pool Manager – Normal CPU Time Reptor MODULE NAME SECTION NAME . ADABAS. SUPERVS. ADABAS. SVC. ADABAS. NUCLEUS. ADABAS ADARPS IGC 0024 A ADANC 0 ADANC 6 ADANC 1 SVC 114 ADANC 7 ADANC 5 IEAVESLK ADAIOS LINE NUMBER PROCEDURE/FUNCTION NAME ADARPS ADANC 0 ADANC 6 ADANC 1 ADANC 7 ADANC 5 PSHSTK STARTING LOCATION ADABAS SYSTEM SERVICES SUPERVISOR SERVICES ADABAS USR/HYP EXIT CALL ADABAS BUFFER POOL MNGER ADABAS THREAD SELECTION EXCPVR ADABAS FORMAT TRANSLATOR ADABAS QUEUE PROCESSING SUSPEND LOCK SERVICE ADABAS I/O PROCESSING PROCEDURE LENGTH CPU TIME SOLO 27. 27 13. 64 9. 09 8. 18 7. 27. 00 3. 64 2. 73 5/22/2021 | Software AG User Group 2011 | 18

LBP= ++ LFIOP= -LRPL= ASYTVS=YES FMXIO=8 Reduce CPU Time and Duration - Solutions Reptor SLOG Prod DB Broker Reptor SLOG ASSO DATA WORK Reptor SLOG 5/22/2021 | Software AG User Group 2011 | 19

Important Parameters - LBP and LFIOP LRPL ADADBS DSBI=OFF ASYTVS=YES and FMXIO= (6 -8, max 16) => SLOG LOGINPUTTRANS= (50 -70) 5/22/2021 | Software AG User Group 2011 | 20

Challenge with Initial-State A file with 160 million ISNs takes too long using RPL’s initial-state function 160 million READs + 160 million STOREs + 160 million ETs Source DB Reptor ASSO DATA WORK SYS Broker Networks Firewalls Routers Target DB ASSO DATA WORK SLOG # Files Adabas Commands/Sec Source / Reptor 160 Millions ISNs 1 990 cps / 438. 60 cps 101. 24 hours = 4. 2 days 7 1, 253 cps / 308. 57 cps 144. 03 hours = 6. 0 days 5/22/2021 | Software AG User Group 2011 | 21

Challenge with Initial-State Solution 1: Source DB ASSO DATA WORK Decompresss Reptor SYS FTP Broker Networks Firewalls Routers Target DB ASSO DATA WORK SLOG Compresss Load 5/22/2021 | Software AG User Group 2011 | 22

Challenge with Initial. State Solution 2: ADAMAGIC Restore ADASAV backup from the mainframe to Windows or UNIX Why not from SAG? 5/22/2021 | Software AG User Group 2011 | 23

Efficient Usage of Adabas Replication - A Practical Solution Finder – By Dieter W. Storr ISBN 978 -3 -8348 -1730 -3 • 11 • 26 Chapter s 2 • 22 Pages 1 • N Figures atur Prog al Monit or • As rams semb ler Prog rams 5/22/2021 | Software AG User Group 2011 | 24

Thank You!