Machine Protection System MPS for the XFEL May

Machine Protection System (MPS) for the XFEL May, 11 th 2009, IEEE NPSS Real Time Conference 2009, Beijing S. Karstensen, I. Cheviakov, L. Fröhlich, K. Rehlich, M. Staack, P. Vetrov (DESY Hamburg)

Machine Protection System for the XFEL Table of Contents n n n n XFEL overview MPS - Tasks - Architecture - Structure in XFEL - Reaction Times Timing System XFEL Operation Modes AMC Hardware MPS Test Set Up x. TCA Technology DOOCS Control System May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 2

Machine Protection System for the XFEL overview General n. Total length n. Number of sites n. Depth of the tunnels n. Costs (2005) 3. 4 kilometres 3 6 to 38 metres 986 million Euro Schedule n. Construction time n. Operation of the facility n. Users’ Operation 2009 -2014 2015 May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 3 Accelerator n. Type n. Total length n. Acceleration length n. Energy n. Temperature n. Number of modules Superconducting linear accelerator 2. 1 kilometres 1. 6 kilometres 17. 5 billion electron volts minus 271 degrees Celsius 101 Properties of the X-ray laser flashes n. Flashes per second 30 000 n. Wavelength 0. 1 to 6 nanometres n. Duration < 100 fs (<100 *10 -15 s) n. Brilliance (peak) 5· 1033 (photons / mm 2 / mrad 2 / 0, 1% bandwidth) n. Brilliance (average) 1, 6· 1025 (photons / mm 2 / mrad 2 / 0, 1% bandwidth) n. Coherence yes

Machine Protection System for the XFEL MPS – Tasks Switch off or or change mode of XFEL n Detect several states (alarm, warning, hardware problems) n Decide severity of failures n Reduce power of RF guns in case of problems n Independent of other Systems n Online debugging n Use new x. TCA AMC technology n Test-Bench for MPS @ ILC n May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 4

Machine Protection System for the XFEL MPS – Monitoring n n n Beam Loss Montior Status Undulator Status Temperature observation Toroid protection system Injector Laser Control (limiting bunches, etc) Interface to dump kicker and beam distribution system Klystrons / Magnets Vacuum LLRF (Low Level Radio Frequency) other connected systems Slow control function May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 5

Machine Protection System for the XFEL MPS – Architecture n 3 Topology possibilities - star - daisy chain - mixed n scalable n flexible n FPGA driven n fiber optics n 2 master module stations n ~100 slave modules n remote maintenance and reprogramming May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 6

Machine Protection System for the XFEL MPS – Structure in XFEL n n n 7 1. ) injector 2. ) linear accelerator (linac) 3. ) beam distribution system 4. ) undulators 5. ) photon beamlines 6. ) experimental stations 1 2 3 4 360 m 1650 m May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 1970 m 5 6

Machine Protection System for the XFEL MPS – Reaction Times 8 Distance from injector Distance from dump kicker min. number of lost bunches n desired latency < 1 μs excluding cable delays. 0 m – 1970 m 0 n linac end 1650 m – 320 m 69 Simulations have shown that with current FPGA technology, the latency per board is in the range of 40 ns. last undulator 3010 m 1040 m 44 n A serial loop of MPS slaves could hence include a maximum of about theoretically 20 MPS modules Beam loss location Injector Minimum reaction times to MPS alarms at various locations, assuming a signal velocity of 2/3 c. 360 m 1650 m May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 1970 m

Machine Protection System for the XFEL MPS FPGA – Schematic and Structure The FPGA is divided into two sections: n Fixed programmed (1+2) n Application specific (3, 4, 5, 10, 11) May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 9

Machine Protection System for the XFEL MPS – Data Telegram Structure Slave Structure Byte 1 Byte 2 Byte 3 check sum data bits Serial Structure (one field) 10 Slave 1 Slave 2 Slave 3 Slave 4 Slave 5 + + 0 + + + (3 Bytes) (3 Bytes) 1 2 3 4 5 6 7 - typ debug info typ = 0: standard data typ = 1: initialising typ = 2: reserved typ = 3: reserved n preliminary May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg Master n n n 3 bytes for one slave (20 data bits, 4 bits for checksum) up to 5 slaves in a serial line 1 byte as debug- and type-info data flow within a loop

Machine Protection System for the XFEL MPS and the Timing System n n n Strongly connected with the timing system MPS master boards receiving timing information mode preset by machine operator timing system gets XFEL modes by MPS. In turn, the master timing module provides it’s current mode to the MPS master. Stand alone run option Timing System Parameters: n Trigger: Timing resolution: 1. 54 ns Programmable with 32 bits (max delay seconds) n Clocks: Jitter: < 5 ps RMS (goal) Constant or burst (e. g. bunch clock) Automatic adaption of location/beam mode n Raw 1. 3 GHz telegrams with encoded data Data format is not yet fixed(e. g. number of filler words for the clock recovery TBD) n In cooperation with Stockholm University May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 11

Machine Protection System for the XFEL – Operation Modes XFEL operation modes can be changed: n manually - Shift operators manually n automatically - by the MPS itself (broken devices, magnets, valves, …) - timing system 2 areas n 1 st for gun 1&2 - maximal 256 different modes n 2 nd for dump kicker - only 3 modes (SASE 1, 2 and DUMP) n Modes can be changed between two beam fills Operation modes for gun 1, gun 2, and for the dump kicker. An operation mode describes the path electrons take through the machine. May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 12

Machine Protection System for the XFEL AMC 1 Board - DESY development n n n n n Hot Swap Facilities IPMI management 4 PCI Express lane – edge connector and VIRTEX Rocket I/O; 4 high speed serial full duplex external interface – front panel connector and VIRTEX Rocket I/O; triggers and clock signals for ADC/DAC can be delivered from front panel connector, edge connector or from VIRTEX-5 Includes diagnostic LEDs (FHB – FPGA Heart Beat) designed in accordance with ATCA / μTCA standard Mezzanine Board with two ADC and two DAC with 14 bits resolution each (actual) DESY in house development of FE Group Industry is very interested in this device and has overtaken the production May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 13 Mezzanine Board SFP (Fiber Optics)

Machine Protection System for the XFEL MPS - Test Set Up 14 Hardware: Software: n 1. ) USB – JTAG module n XILINX ISE 9. 2 i n 2. ) AMC master board n XILINX Chip. Scope Pro 9. 2 i n 3. ) AMC slave board n 4. ) 8 digital switches (INPUT) n 5. ) 8 LEDs (OUTPUT) n 6. ) Serial connection 4 1 3 6 2 1 5 May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg

Machine Protection System for the XFEL x. TCA Technologie 15 n Standard management on crate and board level for all x. TCA systems - Shelf management - Remote maintenance - Hot swap able n Scalable modern architecture - up to 99. 999% availability - full redundancy possible - serial communication (no bus system) PCIe, Gb-Ethernet n x. TCA will replace VME (old standard since 1981) n Driven by telecommunication market n Defined as the XFEL standard platform - Implementation into DOOCS Control System - successful evaluation of µTCA since 2006 at DESY AMC boards ATCA blade µTCA shelf ATCA shelf May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg

Machine Protection System for the XFEL DOOCS - the control system 3 layers • User applications n GUI, Web, etc. • Middle layer n FSM, FB n DAQ • Device level n ~ 200 server types n Local cfg, arch n n n n common APIs modular design multi protocol RPC TINE EPICS Tango Shared Memory n MPS is embedded at the device level May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 16

Machine Protection System for the XFEL – today May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg 17

Machine Protection System for the XFEL 18 Thank you very much for your attention ! You like to have more detailed information? Please contact me: Sven. Karstensen@desy. de May, 11 th 2009, 16 th IEEE NPSS Real Time Conference 2009, Beijing Sven Karstensen, DESY Hamburg