Event System and Embedded IOCs kazuro furukawa kek

Event System and Embedded IOCs < kazuro. furukawa @ kek. jp > Event System and Embedded IOCs at KEK Recent Activities at KEK MRF Event System for 50 Hz Beam Switching F 3 RP 61, PLC-Embedded IOCs, etc ATCA/ TCA for LLRF Kazuro Furukawa < kazuro. Furukawa @ kek. jp > For KEKB and Linac Control Groups May. 1. 2009. EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 1

Event System and Embedded IOCs Simultaneous Injection Requirements u. Linac clients v. KEKB 8 -Ge. V e– 1 n. C x 2 3. 5 -Ge. V e+ 1 n. C x 2 (with 10 n. C primary e–) v. PF 2. 5 -Ge. V e– 0. 1 n. C v(PF-AR 3 -Ge. V e– 0. 2 n. C) u. At first simultaneous top-up injections to three rings at KEKB and PF v. Switching beams at 50 Hz v. For stable operation and higher quality exp. results EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 2

Event System and Embedded IOCs Event System Configuration u MRF’s series-230 Event Generator / Receivers. u VME 64 x and Vx. Works v 5. 5. 1. u 114. 24 MHz event rate, u EPICS R 3. 14. 9 with Dev. Sup v 2. 4. 1. 50 Hz fiducials u 13 event receivers for now. u. More than hundred Event Generator Central 50 Hz-Analog/Timing PVs u. Multi/single-mode fiber u. Timing precision is < 10 ps. KL_B 5/B 6 SB_B v < 1 ps with external module. SH_A 1 e− Gun ARC e– BT (PF: 2. 5 Ge. V, 0. 1 n. C) Cont-ABC KL_51/52 SB_3 SB_4 SB_5 e+ BT (KEKB: 3. 5 Ge. V, 2 n. C) e+ Target Cont-1 Cont-2 Cont-3 Cont-4 Event Receivers EPICS Meeting, Vancouver Cont-5 e– BT (KEKB: 8 Ge. V, 2 n. C, PFAR: 3. 0 Ge. V, 0. 1 n. C) Kazuro Furukawa, KEK, May. 2009. 3

Event System and Embedded IOCs Event System Synchronization Scheme u. Synchronization Req. for PF v. KEKB : < 30 ps v. PF : < 300~700 ps Linac SHB 114. 24 MHz PF Circumference Correction Flip-flop PF Revolution 1. 6 MHz Flip-flop 50 Hz Event System u. Linac rf is Synchronized to KEKB rf u. Event Clock is 114. 24 MHz u. We have to manage AC Line Sync. Bucket Selection Event System for KEKB Clock Fiducial 114. 24 MHz x 5 Rubidium SG 10 MHz HER/LER Injection Phase Control 571. 2 MHz SG 508. 89 MHz 2856 MHz Acc. Phase, Timing Control 508. 89 MHz HER/LER Bucket Selection EPICS Meeting, Vancouver SHB 2 Phase Control x 5 X 49 ÷ 275 KEKB HER/LER Circumference Correction SHB 1 Phase Control v. Circumference compensation v. Bucket selection v. Injection phase controls ÷ 5120 99. 39 k. Hz KEKB Revolution Kazuro Furukawa, KEK, May. 2009. 4

Event System and Embedded IOCs Event System Beam Mode Pattern Generation Pulse 1 Pulse 2 Pulse 3 Beam Mode 1 Beam Mode 2 Beam Mode 3 Pulse n ……… Beam Mode n Main event code for ‘n’ u Every pulse (every 20 ms) corresponds to a beam mode. u 10 different beam modes are defined (for KEKB e+, etc). u One beam mode may contain many event codes. Preparation event code for ‘n+1’ v. At least one main code and a preparation code for the next pulse. u Beam pattern buffer length (n) can be 2 to 500 (20 ms x 500 = 10 seconds). u A new pattern can be loaded at the end of the previous pattern. u Otherwise, the pattern repeats forever. u Pattern generator software arbitrates requests from downstream rings. u There are many pattern rules due to pulse device features and limitations. u Pattern generator software is written in scripting languages to meet daily changes during the commissioning stage. EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 5

Event System and Embedded IOCs Beam Mode Pattern Generators u. There are several versions v. Because we were commissioning new pulsed hardware equipment, the beam optics schemes, event system itself, etc, since autumn 2008 v. One of them is mostly used, remote or human controllable, automaticprioritized arbitrated, etc Remote controlled automatic pattern arbitrator Manual pattern generator v. Typical operation in Apr. 2009. ³~25 Hz for KEKB LER ³~12. 5 Hz for KEKB HER ³~0. 5 Hz for PF EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 6

Event System and Embedded IOCs Event System LLRF u. LLRF Timing/analog signals are essential for absolute energy, energy spread, and dual-bunch energy equalization. u. Signals are switched pulse-by-pulse. u. Value changes are triggered by a preparation event. EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 7

Event System and Embedded IOCs Event System BPM u. Tektronix DPO 7104 can acquire data at 50 Hz. v. With embedded EPICS u. Beam modes are recognized by events through CA network. u. Clients can monitor data of an interested beam mode. u 26 oscilloscopes are installed. u 100 BPMs are synchronized. (100 BPMs at BT as well soon) EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 8

Event System and Embedded IOCs Event System Linac Event System u. Satisfies the requirements v. Event rate : 114. 24 MHz v. Fiducial rate : 50 Hz v. Timing jitter (Short term) : ~8 ps v. No. of defined events : ~50 v. No. of receiver stations (now) : 13 v. No. of Fast parameters (now) : ~120 CPU EVG EVR Opt. Fan-out u. Beam currents are kept within v. KEK 2 m. A (improving) v. PF 0. 1 m. A (in 450 m. A) EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 9

Event System and Embedded IOCs Event System KEKB Operation Improvement Belle/KEK Feb. 2005 Continuous Injections May. 2000 Apr. 2003 Dual Bunch e+ Dec. 2008 Crab Cavities and Quasi-simultaneous Injection EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 10

Event System and Embedded IOCs PLC embedded IOC (Initial) PLC usage at KEK u. At e–/e+ Linac v. We enforced that all the new controllers should be connected over IP/Ethernet since 1993 (instead of other field networks) v. PLC was much cost-effective compared with VME ³if the speed requirement allows v. Products from OMRON, Mitsubishi, Yokogawa, etc. were installed ³Only Yokogawa (FAM 3) remained and others were removed, because maintenance capability over network was better w. Ladder software downloadable over IP/Ethernet, etc. w(Recently Mitsubishi also added that feature) v 170 PLCs (with Ethernet) used for RF, Magnets, Vacuum, (Safety), etc u. At J-PARC v. Many installations with the same reasons as e-Linac u. At KEKB v. Used indirectly at many devices, over serial or GPIB links u. Even custom hardware modules can be designed (I/O Open) EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 11

PLC embedded IOC Event System and Embedded IOCs Software management with PLCs u. Ideal at the beginning v. Separate software development at control group, at equipment group, or at industrial company v. Later, integration test with IP/Ethernet u. Logic management, however v. Same logics could be placed at ladder software, in EPICS database/squencer (or in high-level applications) u. Speed requirement v. Closed loop over Ethernet was slow, sometimes un-reliable v. Interrupts were possible, but slow and complicated u. Thus, hoped to run EPICS on PLC EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 12

Event System and Embedded IOCs PLC embedded IOC EPICS on PLC u. Vx. Works CPU was available on PLC (Yokogawa, Mitsubishi) ³Besides normal sequence / ladder CPU v. However, license management of vx. Works … u. Yokogawa starts to provide Linux (2. 6) on PLC CPU (F 3 RP 61) v. Brave enough to choose open source environment ³We negotiate with Yokogawa to remove any license issues v. Odagiri/KEK, Uchiyama/SHI-RIKEN, Yamada/KEK made much effort to realize the implementation, (but no need for asynchronous records) v. Takuya-Nakamura/MSC-KEK tailored the environment for KEKB ³Procserv, pcmon, NFS, … u. Three new IOCs are used in KEKB operation v. Since September 2008, and another later, four in total v. Beam mask controllers and Pulsed-quad controllers v. No trouble at all, they run more than 6 months u~20 new IOCs are also used in J-PARC operation now EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 13

Event System and Embedded IOCs PLC embedded IOC F 3 RP 61 (e-RT 3 2. 0) Linux 2. 6. 24 PPC 533 MHz 128 Mbyte RAM 100 Base. Tx x 2 USB IEEE 1394 Serial KEKB Beam mask controller PCI I/O Bus for FAM 3 Module Interface can access to mature FAM 3 I/O Modules Can be combined with conventional ladder CPU Software development environment (ELDK) EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 14

Event System and Embedded IOCs PLC embedded IOC Simple Usage under EPICS Conventional PLC usage OPI Clients PLC usage with F 3 RP 61 with asynchronous access IOC (Logics) Ladder CPU (Logics) FAM 3 PLC I/O Modules with only synchronous access and maybe with sequencer OPI Clients F 3 RP 61 IOC FAM 3 PLC I/O Modules If necessary, we can combine OPI Clients EPICS Meeting, Vancouver F 3 RP 61 IOC Ladder CPU FAM 3 PLC I/O Modules Kazuro Furukawa, KEK, May. 2009. 15

Event System and Embedded IOCs PLC embedded IOC Device Support u. No need for asynchronous access v. Direct access to all I/O modules u. Can access to registers on ladder CPU v. If necessary u. Interrupts also possible u. Logics can be database links or sequencers u. Did extend the number of EPICS developers u. Source code and documents vhttp: //www-linac. kek. jp/cont/epics/f 3 rp 61/ v. Local development, PREEMPT_RT realtime (Yamada, et al) EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 16

Event System and Embedded IOCs Other Developments at KEK u. By A. Akiyama, et al v. Embedded IOC on FPGA controller u. By M. Satoh, et al v. Embedded IOC on oscilloscopes u. By A. Kazakov, et al v. Redundant IOC (RIOC with OSI supports) v. Redundant Gateway v. ATCA IOC with HPI/SAF support for RIOC ³ATCA for STF/ILC-LLRF and TCA for ERL-LLRF v. Automatic test system environment u. By Klemen Zagar, et al v. Wireshark protocol analyzer for CA EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 17

Event System and Embedded IOCs Thank you EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 18

Event System and Embedded IOCs Timing System 古い Sub-Timing Station EPICS Meeting, Vancouver 新しい Event Receiver Station (Timing 用) 最大 16 出力 Kazuro Furukawa, KEK, May. 2009. 19

Event System and Embedded IOCs FAM 3 failures u 10 Base network interface 10 years ago was weak against broadcast storm v. If we make a Ethernet loop, all the FAM 3 in the segment had died. u. Our rf modulators are very noisy because of its grounding scheme and the voltage of 50 k. V, and 15 -year-old PLC sometimes fails/stops and needs reboot v. About five PLC failures per 60 rf PLCs per year v. About one PLC failure per 50 other PLCs per year u. Recent version has a redundant memory system in CPU module and relatively strong against noises u. Chemical capacitors have a lifetime of 8 years v. We used more than 10 years, and found one failure for 100 PLCs u. Mechanical relays (if it is used) have lifetime v. Electronical lifetime 100 k times v. Mechanical lifetime 10 M times EPICS Meeting, Vancouver Kazuro Furukawa, KEK, May. 2009. 20

Event System and Embedded IOCs Vacuum Controller Internal Magnet Controller Internal Safety Controller Touch Panel Display for RF EPICS Meeting, Vancouver RF Controller Internal Kazuro Furukawa, KEK, May. 2009. 21