Data Consistency Verification with Veridata Lorena Lobato Pardavila

Data Consistency Verification with Veridata Lorena Lobato Pardavila - CERN Replication Technology Evolution for ATLAS Data Workshop

Veridata Overview q q Is a high-performance cross-platform data comparison tool that supports highvolume compares Allows data consistency validation on “hot” data sets CLIENTS OGG Veridata Agents REPOSITORY OGG Veridata CLI SOURCE OGG Veridata Server n: n TARGET DATABASES OGG Veridata Web Replication Technology Evolution for ATLAS Data Workshop 3

Veridata Overview Replication Technology Evolution for ATLAS Data Workshop 4

System Requirements q DYNAMICPORTLIST in each Golden. Gate. Manager process (Might use 20 ports) q For Veridata Agent o o o Every VA must be installed for each database instance that contains data that is to be compared Possibility of running multiple agents from a single install 1 GB of RAM Java 1. 6. 0 or later is required for release 11. 2. 1 Ojdbc 6. jar q For Veridata Server : 200 MB of fixed virtual memory for basic task q Privileges: Create a user and password and database role named VERIDATA_ROLE o o o CREATE SESSION, CREATE TABLE, CREATE VIEW, CREATE PROCEDURE, CREATE SYNONYM Grant VERIDATA_ROLE to the user Specify QUOTA UNLIMITED on the user's default tablespace Replication Technology Evolution for ATLAS Data Workshop 5

Setting up the Veridata Compares 1. Create database connections, source and target 2. Create group, a group of comparing pairs 3. Create compare pairs, what tables to compare 4. Create a job, to run one or more groups 5. Run a job 6. Compare results Replication Technology Evolution for ATLAS Data Workshop 6

Step 1: Connection Create the connection to the corresponding databases where Veridata Agents are displayed Replication Technology Evolution for ATLAS Data Workshop 7

Step 2: Groups Creation Replication Technology Evolution for ATLAS Data Workshop 8

Step 3: Compare pair Replication Technology Evolution for ATLAS Data Workshop 9

Step 4: Job Creation Replication Technology Evolution for ATLAS Data Workshop 10

Step 5: Run / Execute Job Replication Technology Evolution for ATLAS Data Workshop 11

Step 6: Results Replication Technology Evolution for ATLAS Data Workshop 12

Reports Replication Technology Evolution for ATLAS Data Workshop 13

Veridata Key Points ü Powerful tool for the data missing-synchronization identification ü Along with Golden. Gate, allows data real-time integration and continuous availability solutions validated data consistency ü Stores OOS(Out-of-Sync) reports in binary, XML or both ü Agents can connect remotely, not needed installation in target databases ü 200 GB production data have been compared in an ATLAS environment with a speed of 16. 86 MB/sec ü Veridata 12. 1. 3 coming soon § It will have the ability to repair/fix out of sync data § It will require WLS 12. 1. 3 ü Summer Student to investigate deeply Veridata Replication Technology Evolution for ATLAS Data Workshop 14

Live Demo itrac 910: 8830/veridata/ Replication Technology Evolution for ATLAS Data Workshop 15

THANK YOU! lorena. lobato@cern. ch Replication Technology Evolution for ATLAS Data Workshop