National Marine Fisheries Service FIS Electronic Reporting Special

National Marine Fisheries Service FIS Electronic Reporting Special Interest Group: West Coast Groundfish Trawl Catch Share Program - Individual Fish Quota System (IFQ) Presented by: Richard Kang Scientific Data Management, NWFSC Seattle, WA Aug. 24, 2011

Welcome to the Information Age and Electronic Reporting 9/15/2020

What is Data Management? The development, execution and supervision of plans, policies, practices, and programs that control, protect, deliver, and enhance the value of data and information assets. Data Management Association International (DAMA) 9/15/2020

9/15/2020

NMFS customers can confidently find, access, and use our data. “Deliver the right data, information, and services when and where they are needed. ” "To effect a cultural change in which all NMFS data are recognized and managed as a core agency resource, on par with financial and human resources. " 9/15/2020

9/15/2020 • The Magnuson-Stevens Fishery Conservation and Management Act – Oct. 11, 1996 and 2007 • NMFS Catch Share Program • May 2010 - First meeting with NWR • June 2010 - Started Requirements gather process • Sept 2010 - No contractors on board til end of month • Sept – SER lockdown visit (Irene • Nov 2010 - first Prototype • Dec 17, 2010 – Requirements Completed • Dec - User reviews and changes to interface • Dec - working weekend and nights (web conference) • Jan 2011 - Testing, Testing • Jan 2011 - Multiple releases, collisions, and coordination • Jan 11, 2011 12: 00 - West Coast Groundfish Catch Share Trawl Program or IFQ launched • Jan – Parties with SDM • Numerous releases and fixes • Mar - Presentation to Pacific Fisheries Council • June – Maintenance • Aug 2011 – Phase II Admin and Renewals development

Tools: • • • 9/15/2020 Oracle DB Ver. 10 Oracle Designer 10 Oracle Ap. Ex 3. 0 for reporting/Adhoc Query reports Oracle SQL Developer/Toad Subversion control Java (middle tier and web service) PL/SQL Adobe Flex 3. 0 (Action Script) Visio, Flex Designer (Visual Interface) Oracle and Beehive Collaboration Suite NWFSC Infrastructure – secured

9/15/2020

Deliver IFQ Application Database in 6 months by Jan. 1 2011 Actual Implementation Jan. 11, 2011 at 12: 00 PM Legislation, Policy, and Business Rules Review Existing Systems Discoverable Metadata In In. Port 9/15/2020 Functional Requirements (Use Cases) IFQ Pilot Year Jan. 11, 2011 Functions and Entity Analysis User Acceptance Review

IFQ Development Portal 9/15/2020

IFQ Collaboration, Document and Content Management

9/15/2020

Data Flow Process 9/15/2020

QA/QC Process 9/15/2020

IFQ Entity Relationship Diagram 9/15/2020

Data Dictionary 9/15/2020

Function Hierarchy 9/15/2020

IFQ Database Environment and more

IFQ Release Process 9/15/2020

IFQ Production 1. 3. 3 Training Videos IFQ Application User Help Guide Query & Search Tool

IFQ DOCUMENTATION 9/15/2020 STAGES DOCUMENTS/ CHAPTERS STATUS Current Application Version Number STRATEGY ANALYSIS DESIGN DEVELOPMENT DOCUMENTATION TESTING DATA QUALITY / ASSURANCE TRANSITION DEPLOYMENT SDM Contact and Lead Developer BUDGET Scoping Document / Grant Proposal* Project Management Plan Functional Requirements System Architecture Workflow Document Functional Specification* Logical Design* Crud Matrix Physical Design* Data Dictionary* Milestones Source Code Unit Testing One Page Summary Tutorial User Guide DBA Guide Help (Context Sensitive Help) System Test Plan Document Test Cases and Scripts Type of Testing V 1. 3. 3 Rich Kang / Jeff Cowen Yes No Yes Draft Yes Draft Yes Subversion Done Yes Yes No Yes Yes Manual Data Quality Plan Data Uploading Scripts/ Document SDM Release Document IT Forms: Project Initiation Checklist Web Site Policy Checklist Web Accessibility Checklist Web Application Security Checklist Quality Control Checklist Metadata Published in Inport Draft Yes Yes

Next Steps • Phase II IFQ administrative requirements and enhancements – Summer/Fall 2011 • Account renewals for 2011 • Economic Data Survey database system linkage • Year 2 rollover on Jan. 1, 2012 • Complete detailed system documentation • Implement scalable redundant array cluster (RAC) • Apply lessons learned to on-going projects for further integration • Observer Program development Oracle DB Observer in Database and Apex Website Observer Client in Apex and Oracle XE DB – Dec. 31, 2011 Observer Program Logistics Database – Oct. 1 Observer with Ad. Hoc Query in Apex/GIS - 12/2012 9/15/2020 • Celebrate team successes

Economic Data Survey Collection built in 6 weeks 9/15/2020

9/15/2020

Metadata Card Catalog 9/15/2020 https: //inport. nmfs. noaa. gov/inport/item/11090

Lessons Learned 9/15/2020 • Borrow, learn, and adopt what others have done, • ASK FOR HELP!!! • Alaska Region and Center, Pacific States, Southeast Region*, NWR, OLE, NWC and potential users • Capture extensive business requirements and rules from all participants, extensive review process and the Regs • The right people, tools, methods, and budgets • User feedback, bugs, and timely responses until resolved, • Try new tools (Adobe Flex) and processes (Subversion) leverage past successful efforts (Oracle Ap. Ex, PL/SQL/Java) and enterprise infrastructure supported by IT, • Web services/ODBC to integrate disparate DB over the web • Top Down, Agile, and Spiral (don’t get stuck on methodology). • Data QA/QC resolution issues will take significant time and resources as part of maintenance

Conclusions Data management and Electronic Reporting is successful when your project: • supports agency’s high priority mission, • will result in positive management support, • sufficient budgets, • the right people, tools, and methods, • meets tight timeframes • appreciative customers, • lead by successful examples, • celebrate successes, 9/15/2020 • Just Do It and Deliver and hope you survive!

9/15/2020

Q & A 9/15/2020 Crew for hire. Will share code and knowledge. Contact SDM Helpdesk

Websites NWR and NWC Websites: https: //webapps. nwfsc. noaa. gov/ifq http: //www. nwr. noaa. gov/ 9/15/2020