OCS Scheduler Status Francisco Delgado TS Software Manager

OCS Scheduler Status Francisco Delgado T&S Software Manager LSST Joint Technical Meeting 2017 -03 -07 | Glendale, CA Name of Meeting • Location • Date - Change in Slide Master 1

Automatic & Dynamic LSST Scheduler v LSST as a robotic observatory v Targets are Field/Filter v Survey is automatic v Multiple science goals v Combine area distribution with temporal sampling v Dynamic adaptation to weather v Flexibility for survey adjustments during operations v Flexibility for changes in science programs 2

Prototype History § Op. Sim 1 § Proof of concept in IDL § Simulation of visits with multiple science cases. § Op. Sim 2 § Python § Detailed model for the observatory and the weather § Embedded Scheduler prototype § Telescope design validation, site selection § Op. Sim 3 § Additional science cases and scheduling algorithms § Modular Scheduler prototype § Parameters exploration, survey definition validation 3

OCS Requirements Flow Down Science Requirements Document LPM-17 Science Book Science Collaborations LSST System Requirements LSE-29 Metrics Requirements DOC-15319 Observatory System Specifications LSE-30 Telescope & Site Requirements LSE-60 Op. Sim Requirements LSE-189 Observatory Control System Requirements LSE-62 Scheduler Requirements LTS-347 4

History of Reviews § § § 2011 -08 -29 NSF Preliminary Design Review 2012 -05 -30 NSF Joint Interface & Management Review 2013 -02 -06 OCS/TCS Software Review 2013 -12 -03 NSF Final Design Review 2014 -02 -04 Op. Sim/Scheduler Review 2014 -08 -01 Start of Construction 2014 -09 -10 OCS Interface Review 2016 -02 -08 NSF Status Review 2016 -08 -16 NSF/DOE Status Review 2016 -10 -20 OCS/TCS Software Status Review 2016 -11 -17 T&S Integration Review 2017 -01 -24 DOE/NSF Commissioning Review 5

Control Context Observatory Control System OCS Application OCS Scheduler TCS OCS Sequencer CCS OCS EFD DMCS 6

Simulation Context Operations Simulator v 4 OCS Scheduler Simulated OCS (SOCS) 7

Control Data Flow OCS Operator OCS Remote OCS Application OCS EFD OCS Monitor Control History Telemetry Scheduler OCS Sequencer Image Quality Cmd Visits Sched Targets Telem Visits OCS communications Middleware TCS CCS DM 8

Simulation Data Flow Control History Telemetry Scheduler Image Quality Sched Targets Telem Visits OCS communications Middleware SOCS 9

Internal Block Diagram Time Sched Config Control Driver Main Sched Mode Cost functions Downtime Scheduler Targets Sched Telem Degraded Sched Telem Slew Time Telemetry Observatory conditions Targets Observatory Model Sky Model Weather forecast Image Quality History Environment conditions Quality parameters Past observations Visits Pre-Calc Data Current observation Candidates Proposals Value functions Observation History 10 10

Science Proposal Classes Ø Scripted proposals Ø Designed to produce a pre-determined sequence Ø Basic parameter: scripted cadence of targets Ø Area distribution proposals Ø Designed to obtain uniform distribution Ø Basic parameter: goal visits per filter Ø Look-ahead info: future available time for the targets Ø Time distribution proposals Ø Designed to obtain specified intervals in sequences Ø Basic parameter: time window for visits interval Ø Look-ahead info: visibility for next intervals 11

Accuracy changes Repeatability 100% repeatability in observations sequence and slew states Alt-Az precision Alt-Az estimated at slew. Init and recalculated at slew. Final Difference can be seen between “target” and “slew. Final. State” Remaining tracking time Taken into account before sending target (+30 seconds) Avoid reaching tracking limits in altitude, azimuth or rotator 12

Accuracy changes Sky brightness model New model, per band, includes explicit twilight Configurable moon avoidance New sky model also includes it (built-in) No caching ranks (reuse) Everything is ranked at each visit 13

Ranking a Target Ø Hard constraints Ø Global • Filter change rate, burst and average • Observatory kinematic limits Ø Per Proposal • Airmass • Transparency • Seeing • Sky region (dynamic for rolling cadence) Ø Per Filter • sky brightness 14

Area distribution algorithms Need ratio 15

Area Distribution changes Time window hybrid Optional configurable grouped timed visits The first in the group is area ranked The followings in the group are time-window ranked Same night revisits constraint Revisits to the group during the same night can be avoided No overflow 16

Rank Bonuses Airmass bonus Hour Angle bonus 17

Ranking a Target v Need Function Time Distribution Look-ahead: future sequence feasibility v Value Function 18

Proposals priorities changes Self balancing mechanism 19

1 8 15 22 29 36 43 50 57 64 71 78 85 92 99 106 113 120 127 134 141 148 155 162 169 176 183 190 197 Slew time cost 12 10 8 6 4 2 0 20

Filter change cost 21

Final target rank Value Boost and Cost 22

Serendipity changes Proposal Id based Prop. Id is included in the observation Winners and Losers counted If serendipity is allowed, both lists are searched Coadding is now optional Coadding values for a target in more than one proposal can be disabled 23

OCS Scheduler plan üScheduler v 0. 1 2015 -July OCS Middleware framework üScheduler v 0. 2 2015 -December Observatory kinematic model Scripted targets proposal üScheduler v 0. 3 2016 -May Area distribution proposals Sky brightness model Airmass bonus Slew time cost function Dynamic configuration 24

OCS Scheduler plan üScheduler v 1. 0 2017 -March üFilter swaps around new moon üFilter change rate constraints üFilter change cost function üDowntime handling üClouds handling üSeeing handling üHour angle bonus üSelf balancing proposals üGrouped visits for Area distribution proposals üTime distribution proposals with sequences üParallel subsequences üRolling cadence üDeep drilling 25

OCS Scheduler plan q. Scheduler v 1. 1 2017 -August Deterministic look-ahead area distribution q. Scheduler v 1. 2 2017 -December Deterministic look-ahead time distribution q. Scheduler v 1. 3 2018 -April Speed performance improvements q. Scheduler v 1. 4 2018 -October Warm start to resume partial survey 26

OCS Scheduler plan q. Scheduler v 1. 5 2019 -March Dithering patterns q. Scheduler v 2. 0 2019 -August Predicted schedule publication q. Scheduler v 2. 1 2019 -December Weather forecast handling q. Scheduler v 2. 2 2020 -May Community provided optimizations 27

Validation Op. Sim (Operations Simulator) Scheduler SOCS (Simulated OCS) Observations Database MAF (Metrics Analysis Framework) 28

Analysis of runs 29

Quality Assurance ü ü q ü q Unit Test Integration Test with SOCS Algorithms Validation runs by Systems Engineering Simulations Release Tests (includes installation and fiducial run) Scientific Validation by Science Collaborations Integration Tests with OCS 30

Software Engineering Tools Ø Ø Ø Ø Ø Model Based Systems Engineering Sys. ML modeling with Enterprise Architect PMCS with Primavera Coordination and progress with JIRA Documentation in Docushare Interface controlled in OCS SAL with XML Version control with Git, Stash Mirrored on Git. Hub Continuous Integration with Jenkins Coding standards from Telescope group and Simulations group 31

Summary v Scheduling algorithms validated during prototype effort v Scheduler designed for control and simulation context v Development plan coordinated with SOCS for I&T v Integration activities with Observatory Control System v In Control context the Scheduler drives the LSST survey v In Simulation context the Scheduler evaluates alternate surveys for parameters exploration and optimizations during operations 32

Demonstration 33

OCS Software Components Control Monitor Operator Remote AT Scheduler History Telemetry Control EFD Application Sequencer History Telemetry Targets Scheduler Visits Image Parameters Cmds Targets Visits Communications Middleware Telescope Control System Camera Control System Data Management Control System 34

LSST Control Software Architecture Observatory Control System OCS Communications Middleware Telescope Control System Camera Data Image data Acquisition Image data Data Management OCS Communications Middleware TMA Control Dome Control Rotator Control AO Control Environ Control Calib System AT TCS 35