CA Workload Automation DE R 11 1 to

  • Slides: 51
Download presentation
CA Workload Automation DE R 11. 1 to R 12

CA Workload Automation DE R 11. 1 to R 12

Agenda 2 1 NEW JOB TYPES 2 EVENT ENHANCEMENTS 3 AGENTS 4 APPLICATION MANAGEMENT/SCHEDULING

Agenda 2 1 NEW JOB TYPES 2 EVENT ENHANCEMENTS 3 AGENTS 4 APPLICATION MANAGEMENT/SCHEDULING 5 SECURITY ENHANCEMENTS 6 MIGRATING R 11. 1 TO R 12 6 CA WA WEB SERVICES © 2015 CA. ALL RIGHTS RESERVED.

New Job Types

New Job Types

New Job Types – System Agent § Secure Copy/Secure File Transfer Protocol – File

New Job Types – System Agent § Secure Copy/Secure File Transfer Protocol – File Transfer using SFTP and SCP – a § SNMP Subscribe, Trap Send, Value Set, Value Get – Supports SNMP v 1, v 2, v 3 – a § Wake on LAN – Wake up a remote computer that has been soft-powered-down – a 4 © 2015 CA. ALL RIGHTS RESERVED.

New Job Types - Application Services Plugin § JMX-MBean Create Instance – Create an

New Job Types - Application Services Plugin § JMX-MBean Create Instance – Create an Mbean Instance on JMX Server § JMX-Mbean Remove Instance – Remove an Mbean Instance on JMX Server § Web Service Document/Literal and RPC/Encoded – Call SOAP web service operations – a 5 © 2015 CA. ALL RIGHTS RESERVED.

New Job Types - Remote Execution Plugin § Execute commands on remote computers §

New Job Types - Remote Execution Plugin § Execute commands on remote computers § SSH 2 or Telnet § Supported Platforms: NIX, HP Integrity Non. Stop, Open. VMS § Additional Operations for Monitoring – – 6 Get Spool File Reference Retrieve Spool File Job Log Cancel Job © 2015 CA. ALL RIGHTS RESERVED.

New Job Type - Informatica Job Plugin § Execute Pre-defined workflow on Informatica Power

New Job Type - Informatica Job Plugin § Execute Pre-defined workflow on Informatica Power Center § Requires CA Workload Automation Agent Plugin for Informatica § Execute Workflow – Start from beginning or specified task § Additional Commands for Monitoring – – – 7 Get Workflow Logs Get Run Details Get status Restart Workflow Stop Workflow © 2015 CA. ALL RIGHTS RESERVED.

New Job Type - MSSQL Server Job Plugin § Executes predefined jobs in Microsoft

New Job Type - MSSQL Server Job Plugin § Executes predefined jobs in Microsoft SQL Server § Supported Workload – – – SQL scripts Command prompt Active. X scripts Analysis Services commands Replication Tasks § Requires CA Workload Automation Agent for Windows 8 © 2015 CA. ALL RIGHTS RESERVED.

Hadoop Advanced Integration § Manage End to End Hadoop Workflows from Workload Automation §

Hadoop Advanced Integration § Manage End to End Hadoop Workflows from Workload Automation § Requires CA Workload Automation Hadoop AI with System Agent 11. 3. 4 INC 2+ § Supported Types – – – 9 HDFS – Hadoop Distributed File System Hive – Hadoop data warehousing Ooozie – Workflow control Pig – Big data analytics Sqoop – RDMS Import/Export © 2015 CA. ALL RIGHTS RESERVED.

Event Enhancements

Event Enhancements

New Event Types – Variable Dependency § Variable Dependency Monitor Events – Triggers workload

New Event Types – Variable Dependency § Variable Dependency Monitor Events – Triggers workload when Global Variable Expression is satisfied – Evaluates each time the variable is changed § Multiple Variables – AND/OR Logic § Expression Logic – Equals, Not Equal, less than (or equal), greater than (or equal) – Contains, Does not contain – Exists, Does not exist 11 © 2015 CA. ALL RIGHTS RESERVED.

New Event Types – Variable Dependency 12 © 2015 CA. ALL RIGHTS RESERVED.

New Event Types – Variable Dependency 12 © 2015 CA. ALL RIGHTS RESERVED.

New Event Types – Forecast § Schedule Forecast Reporting § Output Formats: CSV, HTML

New Event Types – Forecast § Schedule Forecast Reporting § Output Formats: CSV, HTML § Define in the event users who can read results § Set up Email Notifications when report completes – Can attach report email. Consider report size § Multi-threaded Forecast Report generation 13 © 2015 CA. ALL RIGHTS RESERVED.

New Event Types – History Reports § Schedule History Reporting § Output Formats: PDF,

New Event Types – History Reports § Schedule History Reporting § Output Formats: PDF, Powerpoint, Word, Excel § Define in the event users who can read results § Set up Email Notifications when report completes – Can attach report email. Consider report size § Pre-Specify Report parameters 14 © 2015 CA. ALL RIGHTS RESERVED.

New Event Features § Event Priority – 1 (lowest priority) to 10 highest priority

New Event Features § Event Priority – 1 (lowest priority) to 10 highest priority § Event Trigger Multithreading – 10 threads by default § Bypass any future scheduled event execution – BYPASSEVENT("event") [AT(“time")] § Inherit Trigger User – Events can be set up when manually triggered to inherit the trigger user and use the defined user 15 © 2015 CA. ALL RIGHTS RESERVED.

Agents

Agents

Agent Status in Topology § Ability to see current agent status § Based on

Agent Status in Topology § Ability to see current agent status § Based on heartbeat § Using Aliases – If using plugins use alias – Define System Agent definition to ensure accurate status – Ensure identical host/IP address used for both alias and actual § String matching of host used to identify alias and actual as pair 17 © 2015 CA. ALL RIGHTS RESERVED.

Agent Status in Topology 18 © 2015 CA. ALL RIGHTS RESERVED.

Agent Status in Topology 18 © 2015 CA. ALL RIGHTS RESERVED.

Agent Load Balancing § Agent Groups – Windows or Unix Only § Load Balancing

Agent Load Balancing § Agent Groups – Windows or Unix Only § Load Balancing Options – Round Robin – Random – CPU Monitoring § Performance can be impacted with large group size § Note: Restart agents if removed § Run on All agents § Ensure proper application defaults 19 © 2015 CA. ALL RIGHTS RESERVED.

Define Agent Group 20 © 2015 CA. ALL RIGHTS RESERVED.

Define Agent Group 20 © 2015 CA. ALL RIGHTS RESERVED.

Selecting Agent Group 21 © 2015 CA. ALL RIGHTS RESERVED.

Selecting Agent Group 21 © 2015 CA. ALL RIGHTS RESERVED.

Monitor View – Run On All Agents 22 © 2015 CA. ALL RIGHTS RESERVED.

Monitor View – Run On All Agents 22 © 2015 CA. ALL RIGHTS RESERVED.

Application Management/Scheduling

Application Management/Scheduling

Find Job § Use “Find Job” to find all the jobs on the specified

Find Job § Use “Find Job” to find all the jobs on the specified server matching the filter criteria § Criteria Options – – – Job Name Job Qualifier Application Job Type Agent/Agent Group § Wildcards supported § Control Click to select multiple jobs to open 24 © 2015 CA. ALL RIGHTS RESERVED.

Find Job 25 © 2015 CA. ALL RIGHTS RESERVED.

Find Job 25 © 2015 CA. ALL RIGHTS RESERVED.

Javascript – New Features § Javascripts can now be defined at Job level –

Javascript – New Features § Javascripts can now be defined at Job level – Previously only at Event and Application level – Can be defined to run at Event Trigger or Job Run time § Javascript variables created to store result of previous job – Job Type dependent – APPL. job_name_job_qualifier_return_ value_name § Content Assist § Javascript maximum execution time 26 – 5 minutes © 2015 CA. ALL RIGHTS RESERVED.

Javascript – Define in WOB 27 © 2015 CA. ALL RIGHTS RESERVED.

Javascript – Define in WOB 27 © 2015 CA. ALL RIGHTS RESERVED.

Scheduler/Operators – Additional Capabilities § Wait Mode - Return Monitor On First Occurrence –

Scheduler/Operators – Additional Capabilities § Wait Mode - Return Monitor On First Occurrence – Return Immediately – Monitoring jobs check for conditions immediately and pass/fail depending on results – Return at First Occurrence – Wait for conditions to occur then completes § a § New Monitor State for Notifications – – 28 Force Completed Global Variable Wait Resource Wait Suspend © 2015 CA. ALL RIGHTS RESERVED.

Scheduler/Operators – Additional Capabilities § Active Application Progress Bar – Tracks application status –

Scheduler/Operators – Additional Capabilities § Active Application Progress Bar – Tracks application status – Estimated End Time available if enabled 29 © 2015 CA. ALL RIGHTS RESERVED.

Scheduler/Operators – Additional Capabilities § Artifact Deletion Impact – Scheduler will now notify the

Scheduler/Operators – Additional Capabilities § Artifact Deletion Impact – Scheduler will now notify the user of affected artifacts upon deletion § Applies for: Applications, Calendars, Resources, Alerts, Javascripts, Agents/Groups, Agent Users 30 © 2015 CA. ALL RIGHTS RESERVED.

Scheduler/Operators – Additional Capabilities § Require Reason For Job/Application Commands – Applications/Jobs can now

Scheduler/Operators – Additional Capabilities § Require Reason For Job/Application Commands – Applications/Jobs can now be set to require a reason for any execution commands – Reasons are stored in the command log for future reference § a § Job Ancestor Wait – Job’s can be set to wait until previous its ancestor in a previous generations completes – Allows Application to continue executing but ensures only one execution of a job – Options include wait for previous generation only or wait for all generations § 31 a © 2015 CA. ALL RIGHTS RESERVED.

Restrict agents in job definition Install-Console § How do we restrict certain users from

Restrict agents in job definition Install-Console § How do we restrict certain users from using a specific set of agents defined in the agent topology ? Controlling users permissions to provide them access to a specific set of agents is the solution. § Admin->Security->Groups->Permissions 32 © 2015 CA. ALL RIGHTS RESERVED.

Restrict agents in job definition 33 © 2015 CA. ALL RIGHTS RESERVED.

Restrict agents in job definition 33 © 2015 CA. ALL RIGHTS RESERVED.

Control Subscribe All functionality § Admins can deny users to run subscribe all by

Control Subscribe All functionality § Admins can deny users to run subscribe all by setting deny permissions to the users Security -> Groups -> <Group_name> -> Permissions -> Add -> APPLX. *. *. *. SUBSCRIBEALL 34 © 2015 CA. ALL RIGHTS RESERVED.

Control Subscribe all functionality 35 © 2015 CA. ALL RIGHTS RESERVED.

Control Subscribe all functionality 35 © 2015 CA. ALL RIGHTS RESERVED.

Restrict users to run reset definition/resubmit jobs § Admins can deny users to run

Restrict users to run reset definition/resubmit jobs § Admins can deny users to run reset definition and resubmit job by setting deny permissions to the users appropriately. Security -> Groups -> <Group_name> -> Permissions -> Add -> APPLX. *. *. *. RESET DEFINITION 36 © 2015 CA. ALL RIGHTS RESERVED.

Restrict users to run reset definition/resubmit jobs § Reset definition will not be displayed

Restrict users to run reset definition/resubmit jobs § Reset definition will not be displayed if the user doesn’t have permission to execute command. § Similarly, resubmit job can be controlled in the same way as reset definition. 37 © 2015 CA. ALL RIGHTS RESERVED.

Insert a Job into an Active Application Generation § User can insert a job

Insert a Job into an Active Application Generation § User can insert a job into an active Application generation by issuing the INSERTJOB command. The inserted job runs immediately unless you define predecessor, time, variable, or resource dependencies, or insert the job on hold or on request § You cannot insert a job into an Application that is complete § This command has the following format: insertjob jobname("jobname") qualifier("job_qualifier") application("application. generation") jobtype("jobtype") reason("reason") jobparameters("param 1(value). . . ") – jobname("jobname") ---Specifies the name of the job. – Qualifier("job_qualifier") -- Specifies the qualifier of the job. 38 © 2015 CA. ALL RIGHTS RESERVED.

Enhancement to Housekeeping Applications You can now set up the HOUSEKEEPING_UTILITY Application to delete

Enhancement to Housekeeping Applications You can now set up the HOUSEKEEPING_UTILITY Application to delete status messages that are older than a specific number of days. § Provide 2 kinds of housekeeping utilities - one (HOUSEKEEPING_UTILITY) is for server maintenance and the other (HOUSEKEEPING_DB_NOTIFY) is for Postgre. SQL embedded database maintenance. § User must be able to schedule the application as per their needs. § This application is now provided with server by default and users no longer need to upload this from sample applications 39 © 2015 CA. ALL RIGHTS RESERVED.

Parallel Event Triggering Improvements § Parallel event triggering can be controlled using a shared

Parallel Event Triggering Improvements § Parallel event triggering can be controlled using a shared configuration parameter – “Maximum number of parallel threads for event triggering” 40 © 2015 CA. ALL RIGHTS RESERVED.

Migrating 11. 1 to 12

Migrating 11. 1 to 12

Migration Steps § Link in docops: https: //docops. ca. com/ca-wla-de/120/en/installing/upgrading-the-ca-workload-automation-de-server-from-previousversions 42 © 2015 CA.

Migration Steps § Link in docops: https: //docops. ca. com/ca-wla-de/120/en/installing/upgrading-the-ca-workload-automation-de-server-from-previousversions 42 © 2015 CA. ALL RIGHTS RESERVED.

Source and Target Diagram 43 © 2015 CA. ALL RIGHTS RESERVED.

Source and Target Diagram 43 © 2015 CA. ALL RIGHTS RESERVED.

Migration § Migration Utility – Located in <R 12_install_dir>/bin – Requires user for R

Migration § Migration Utility – Located in <R 12_install_dir>/bin – Requires user for R 11. 1 environment with Administrator privileges § Connects to R 11. 1 from R 12 server to retrieve all artifacts – User can control artifacts before importing into R 12 § migration. default. conf § All artifacts upload at first R 12 start after migration – Global variables and historical data are migrated directly into the database – Migration utility does not merge existing and migrated data – Process can be time consuming depending on artifact volumes 44 © 2015 CA. ALL RIGHTS RESERVED.

Pre-migration Steps § Install R 12 and start – Do not run workload. If

Pre-migration Steps § Install R 12 and start – Do not run workload. If you do, coldstart R 12 before migration § Ensure Firewall Allows New Server/Agent Communication – Ensure R 12 can communicate with source server and database § Only required for migration § Events with past date references can be problematic – Example: current date: 01/01/2016 § Event Schedule: “daily starting 05/14/2014” – Fails to migrate due to old date § Event Suspend: “ 06/16/2014” – Increment suspend count instead – Clear beforehand – Migration log clearly indicates objects not migrated 45 © 2015 CA. ALL RIGHTS RESERVED.

Pre-migration Steps § Backup database prior to migration § Determine logging details – server_install_dir/migration/logs.

Pre-migration Steps § Backup database prior to migration § Determine logging details – server_install_dir/migration/logs. conf. xml § Plan for Agents – Upgrade R 7 agents ahead of time if possible § See Documentation for Agent behavior changes – https: //docops. ca. com/ca-wla-agents-1134 -en/installing/migrating-an-espsystem-agent-to-r 11 -3 – Prepare agentparm. txt files beforehand if possible. § Agents require new manager communication information § Agent recycle required 46 © 2015 CA. ALL RIGHTS RESERVED.

Other Considerations and Notes § Ensure 11. 1 server is fully patched § Source

Other Considerations and Notes § Ensure 11. 1 server is fully patched § Source server is preserved § Recommend that you do not create artifacts or run workload on the new server before migration § Unsupported Characters in Artifact Names § Desktop clients must be upgraded to R 12 – Non-admin user updates are supported – New default path: C: CAWA Desktop Client R 12 – updatesite. bat provides silent installation 47 © 2015 CA. ALL RIGHTS RESERVED.

Migration Script Output 48 © 2015 CA. ALL RIGHTS RESERVED.

Migration Script Output 48 © 2015 CA. ALL RIGHTS RESERVED.

CA WA Web Services

CA WA Web Services

CA WA Web Services § Services must be installed separately § SOAP Based Web

CA WA Web Services § Services must be installed separately § SOAP Based Web Services § Service Function Areas – Event Management § bypass. Event, run. Application. Create, trigger. Add. Event – Application/Job Management – complete. Application, hold. Application – Resource Control § drop. Resource. Dependency, set. Resource. Availability – Global Variable Control § create. Variables, decrement. Variable, eval. Var. Dependency – Artifact Management § list. Artifact, delete. Artifact, list. Version 50 © 2015 CA. ALL RIGHTS RESERVED.

Documentation § Workload Automation DE R 12 – https: //docops. ca. com/ca-wla-de/12 -0/ §

Documentation § Workload Automation DE R 12 – https: //docops. ca. com/ca-wla-de/12 -0/ § Workload Automation Agents 11. 3. 4 – https: //docops. ca. com/ca-wla-agents-1134 -en § Communities – https: //communities. ca. com/community/ca-workload-automation 51 © 2015 CA. ALL RIGHTS RESERVED.