UNISA CAMPUS SOLUTIONS ORACLE CPU PATCHING SESSION 6047

  • Slides: 35
Download presentation
UNISA CAMPUS SOLUTIONS ORACLE CPU PATCHING SESSION 6047 November 8, 2018 ADU 7 -9

UNISA CAMPUS SOLUTIONS ORACLE CPU PATCHING SESSION 6047 November 8, 2018 ADU 7 -9 NOVEMBER 2018

PRESENTERS Robert Lacina Somu Kala Senior Information Technologist University of South Australia Robert. Lacina@unisa.

PRESENTERS Robert Lacina Somu Kala Senior Information Technologist University of South Australia Robert. Lacina@unisa. edu. au Somu. Kala@unisa. edu. au ADU 7 -9 NOVEMBER 2018

UNIVERSITY OF SOUTH AUSTRALIA 6 Campuses 4 City, 2 Regional 35, 000+ Students ADU

UNIVERSITY OF SOUTH AUSTRALIA 6 Campuses 4 City, 2 Regional 35, 000+ Students ADU 7 -9 NOVEMBER 2018

UNISA & PEOPLESOFT Campus Solutions v 9. 2 (Update Image 8) People. Tools 8.

UNISA & PEOPLESOFT Campus Solutions v 9. 2 (Update Image 8) People. Tools 8. 55. 25 CRM for Higher Education v 9. 1 (Bundle 13) People. Tools 8. 53. 04 ADU 7 -9 NOVEMBER 2018

OVERVIEW 3 1 PATCHING PROCESS INTRODUCTION 4 2 BACKGROUND & PLANNING ISSUES AND FUTURE

OVERVIEW 3 1 PATCHING PROCESS INTRODUCTION 4 2 BACKGROUND & PLANNING ISSUES AND FUTURE ADU 7 -9 NOVEMBER 2018

INTRODUCTION What’s this all about? ADU 7 -9 NOVEMBER 2018

INTRODUCTION What’s this all about? ADU 7 -9 NOVEMBER 2018

INTRODUCTION WHAT’S IT ALL ABOUT? • Uni. SA’s CPU Patching Cycle • Background •

INTRODUCTION WHAT’S IT ALL ABOUT? • Uni. SA’s CPU Patching Cycle • Background • Current Patching Process • Issues & Future Direction ADU 7 -9 NOVEMBER 2018

BACKGROUND Where we came from ADU 7 -9 NOVEMBER 2018

BACKGROUND Where we came from ADU 7 -9 NOVEMBER 2018

OLD PATCHING STRATEGY Prior to implementing People. Soft CRM, we didn’t really have an

OLD PATCHING STRATEGY Prior to implementing People. Soft CRM, we didn’t really have an existing plan for security updates or patches to our Campus Solutions product • Once per year • People. Tools & Bundles • No review of CPU releases • Never did Web. Logic or Java • Long development/testing • Long go-live downtime ADU 7 -9 NOVEMBER 2018

CRM IMPLEMENTATION • CS Servers - all internal • CRM - External-facing servers •

CRM IMPLEMENTATION • CS Servers - all internal • CRM - External-facing servers • Start of CPU planning • Weblogic & Java only • CS - External-facing servers ADU 7 -9 NOVEMBER 2018

SERVER PATCHING • Server binaries done manually • Installer run manually on every server

SERVER PATCHING • Server binaries done manually • Installer run manually on every server • Small number of servers • CS 9. 2 Infrastructure changes ADU 7 -9 NOVEMBER 2018

CRM SERVER HACK • Crypto-currency mining • Scheduled to be patched • Server decommissioned

CRM SERVER HACK • Crypto-currency mining • Scheduled to be patched • Server decommissioned • Used for marketing tracking • New server built, never used ADU 7 -9 NOVEMBER 2018

LESSONS LEARNED • Firewall not relevant • F 5 did nothing • Assume the

LESSONS LEARNED • Firewall not relevant • F 5 did nothing • Assume the worst • Need to be more responsive • Decision made to always patch • Incentive to automate ADU 7 -9 NOVEMBER 2018

CURRENT PATCHING PROCESS Where we are now ADU 7 -9 NOVEMBER 2018

CURRENT PATCHING PROCESS Where we are now ADU 7 -9 NOVEMBER 2018

CPU RELEASE ANALYSIS • Day after CPU release • Who’s involved • Review each

CPU RELEASE ANALYSIS • Day after CPU release • Who’s involved • Review each CVE • Overall score • Look at three main factors ADU 7 -9 NOVEMBER 2018

TIMELINES • Planned well in advance • Weblogic & Java • People. Tools &

TIMELINES • Planned well in advance • Weblogic & Java • People. Tools & Elastic Search ADU 7 -9 NOVEMBER 2018

PATCHING ENVIRONMENTS • Apply to sandpit • Dev & Test • Other non-prod •

PATCHING ENVIRONMENTS • Apply to sandpit • Dev & Test • Other non-prod • Still applying manually ADU 7 -9 NOVEMBER 2018

HOW DO WE MAKE IT BETTER-SOMU • Patching 4 Times a Year • 86

HOW DO WE MAKE IT BETTER-SOMU • Patching 4 Times a Year • 86 * 4 times No of servers • Patching Manually • Come Up with a Solution ADU 7 -9 NOVEMBER 2018

RED HAT SATELLITESOMU • Red Hat Satellite • Owner-Systems Infrastructure Team • Hijacked it

RED HAT SATELLITESOMU • Red Hat Satellite • Owner-Systems Infrastructure Team • Hijacked it for our Agenda • How do we use it? ADU 7 -9 NOVEMBER 2018

PATCHING PROCESS PREVIOUSLY-SOMU • Manual Effort- Repetitive • Time Taken • Quality Suffered •

PATCHING PROCESS PREVIOUSLY-SOMU • Manual Effort- Repetitive • Time Taken • Quality Suffered • Resources ADU 7 -9 NOVEMBER 2018

PATCHING PROCESS NOW - SOMU • Automated • Turn Around Time • Resources •

PATCHING PROCESS NOW - SOMU • Automated • Turn Around Time • Resources • Better Quality ADU 7 -9 NOVEMBER 2018

RESULT QUALITY TIME EFFORT ADU 7 -9 NOVEMBER 2018

RESULT QUALITY TIME EFFORT ADU 7 -9 NOVEMBER 2018

DEMONSTRATION-SOMU ADU 7 -9 NOVEMBER 2018

DEMONSTRATION-SOMU ADU 7 -9 NOVEMBER 2018

NESSUS-SOMU • Pre Patch Scan • Post Patch Scan • Security Team Sign Off

NESSUS-SOMU • Pre Patch Scan • Post Patch Scan • Security Team Sign Off • All Good ADU 7 -9 NOVEMBER 2018

APPLICATION TESTING • Official test plan • Weblogic & Java • People. Tools –

APPLICATION TESTING • Official test plan • Weblogic & Java • People. Tools – Technical • People. Tools – Business • Issues Register • Load Testing ADU 7 -9 NOVEMBER 2018

ISSUES & FUTURE Issues faced and where we want to be ADU 7 -9

ISSUES & FUTURE Issues faced and where we want to be ADU 7 -9 NOVEMBER 2018

UNHAPPY USERS! • Testing 5 x per year • Different testing required • Wanted

UNHAPPY USERS! • Testing 5 x per year • Different testing required • Wanted to know what to test ADU 7 -9 NOVEMBER 2018

BROKEN CUSTOMISATIONS • In-House Research Portals • Single-signon and branding • Cumulative PT patches

BROKEN CUSTOMISATIONS • In-House Research Portals • Single-signon and branding • Cumulative PT patches always break our stuff! • Changes were not well documented! ADU 7 -9 NOVEMBER 2018

PIA RE-DEPLOY • Need to re-deploy PIA • Silent install not working • Need

PIA RE-DEPLOY • Need to re-deploy PIA • Silent install not working • Need to do manually • Need to reconfigure ADU 7 -9 NOVEMBER 2018

COBOL COMPILES • Planned well in advance • Weblogic & Java • People. Tools

COBOL COMPILES • Planned well in advance • Weblogic & Java • People. Tools ADU 7 -9 NOVEMBER 2018

DPK & PUPPET • Not using DPKs or Puppet • No more “CD” installs

DPK & PUPPET • Not using DPKs or Puppet • No more “CD” installs • Should work with Satellite • Old versions of WL/Java ADU 7 -9 NOVEMBER 2018

SUMMARY • Went from patching 1 4 x • Semi-Automated • Up-to-date by next

SUMMARY • Went from patching 1 4 x • Semi-Automated • Up-to-date by next CPU • Happy Security Admins! ADU 7 -9 NOVEMBER 2018

CONCLUDING THOUGHTS ANY QUESTIONS? ADU 7 -9 NOVEMBER 2018

CONCLUDING THOUGHTS ANY QUESTIONS? ADU 7 -9 NOVEMBER 2018

PRESENTERS Robert Lacina Somu Kala Senior Information Technologist University of South Australia Robert. Lacina@unisa.

PRESENTERS Robert Lacina Somu Kala Senior Information Technologist University of South Australia Robert. Lacina@unisa. edu. au Somu. Kala@unisa. edu. au ALLIANCE PRESENTATIONS WILL BE AVAILABLE FOR DOWNLOAD FROM THE CONFERENCE SITE ADU 7 -9 NOVEMBER 2018

THANK YOU! ADU 7 -9 NOVEMBER 2018

THANK YOU! ADU 7 -9 NOVEMBER 2018