NSLSII Control System Overview The Control Group

NSLSII Control System Overview The Control Group – presented by Bob Dalesio NSLS-II ASAC Review October 14, 2010 1 BROOKHAVEN SCIENCE

Outline • Fast Orbit Feedback Component • • • Development High Level Application Status Documentation of Facility in an Relational Data. Base - IRMIS EPICS Extensions Control System Studio (CSS) Tools Subsystem Status and Standards Conclusions 2 BROOKHAVEN SCIENCE

Orbit feedback system architecture Fast orbit feedback system in one cell 3 BROOKHAVEN SCIENCE

Orbit feedback system architecture NSLS-II two tier device controller architecture Cell 1 Cell 30 Cell 29 Cell 3 Storage Ring SDI link Cell 17 Cell 15 Cell 16 4 BROOKHAVEN SCIENCE

Fast Orbit Feedback – Time Budget • 6. 7 µs for BNL BPM Electronics delay to pipeline • 7 µs measured BPM data distribution by Shared Memory • 4 µs measured for FOFB calculation with separate mode compensation 5 µs measured for set power supply by PS Shared Memory link 8 KHz measured for fast corrector PS bandwidth w 10 deg phase shift. 1 KHz measured for corrector magnet/chamber bandwidth. • • 3. 7 µs for analog value averaged from raw data • 3 µs estimated for BNL BPM Electronics • 57 µs measured on Libera BPM Electronics with minimum filter • 14 µs measured when one of the redundant links not operational • Measured on with Inconel beampipe. This value is at 10 degree phase shift. • New magnet/chamber set up will be tested when they are available. 5 BROOKHAVEN SCIENCE

Fast Orbit Feedback Test Stands Digital Front End Board and BPM analog electronics Digital Front End with Cell Controller I/O Soft IOCs PPS Test. Power supply interface modules Stand Power Supply Controllers 6 BROOKHAVEN SCIENCE

Fast Orbit Feedback • Digital Front End (DFE) Used as Beam Position Monitor (BPM) Front End • Digital Front End Used as Cell Controller • Power Supply Controller (PSC) is ready for production • Power Supply Interfaces (PSI) is ready for production • • • redundant ring communication working at 2. 5 Gbps embedded event receiver with <5 psecs jitter and 8 nsecs of resolution. Second spin will upgrade the FPGA from a Virtex 5 to a Virtex 6 – February time frame • • raw analog at 116. 9 MHz to Memory for up to 1 Gbytes turn by turn data at 378 KHz to Memory for up to 32 MB (2. 5 seconds) transfer of large arrays at under 2 minutes for under 32 MB over Modbus over Ethernet transfer of large arrays at under 16 seconds for 32 MB over Ethernet 10 Hz BPM data to Memory; has several hundred DSP slices for digital filtering Virtex 5 has >90% Memory registers in use – Virtex 6 will give us 5 x more. • • • calculates fast orbit feedback algorithm for local in 4 microseconds matrices for up to 90 eigenvectors; I/O board can be used for fast machine protection – 16 digital input, 12 digital outputs and 4 analog outputs for fast machine protection; – four 100 Mbps copper ports for redundant comm links to the fast and slow power supplies. • • • provides redundant 100 Mbps network to all power supplies within one cell. provides Memory access by Modbus protocol over 100 Mbps Ethernet dedicated fiber from each Power Supply Control to each Power Supply Interface. • • • demonstrated < 5 ppm long term stability takes 10 KHz data for up to 10 seconds for diagnostics 20 bit DAC (1 ppm resolution), 16 bit ADCs for DCCT 7 BROOKHAVEN SCIENCE

High Level Applications (HLA) • • High level applications requirements are identified and being refined High level application architecture is client/server • New data types have been defined for multichannel arrays, multidimensional arrays, images, statistical samples, tables (arbitrary collections). • based on the EPICS version 4 network protocol, PVAccess • One server provides results to all clients • These are being implemented in PVAccess • Servers are completed that provide: • • • Other Services are under development. Developer document for thin clients is being written in conjunction with the physics group. Standard clients in CSS can be used to display HLA data • Model Results • List of process variables based on function and attributes • Synchronous vector of data given a list of process variables. 8 BROOKHAVEN SCIENCE

Client-Server Architecture for HLA Production HLA Client MMLT Client Scripting HLA Client PVAccess/CAC Control System Studio Completed Early Development Being Extended PVAccess / CAC Ethernet PVAccess/CAC PVAccess Model Server Lattice Server Channel Finder Svr Elegant/Tra cy Middle Layer Servers PVAccess SQL IRMIS Distributed Front-Ends PVA CAS Diagnostics Power Supplies Physical Device RDB Multi. Channel Arrays Svr Serves orbit, magnets, any array of channels Save/Comp are Restore Svr SQL Magnet Conv, Response Matrix, Dispersion, etc…. IRMIS PVA CAS RF Vacuum Utilities etc. . , Diag & PS Physical Device LS 2 Simulation 9 BROOKHAVEN SCIENCE

IRMIS • Production tools available for • • Control group members have started to enter component types Subsystem engineering groups have started to enter component data Subsystem engineering groups have done initial testing of the wiring editor Rapid prototyping tools are in place to support developing applications • • Physics group and mechanical group are working with us on these IRMIS Crawler, which was developed at Argonne, looks at EPICS configuration files and provides data management. • • Component type editor Component Browser Wiring Editor • • • Lattice Electronic log Save Compare Restore (SCORE) Magnet Measurements Component Inventory and History • We have no deployed databases or clients so this is not yet in use. 10 BROOKHAVEN SCIENCE

PERL crawler Rapid Prototype Environment: - lattice PERL: - cmpnt inventory -epics config software - cmpnt history - CA clients - magnet measurements - history - traveler - elog - pv_meta - service config (alh, Data Services Layer: ar, score) - logscore - component types - cmpnt channels - cmpnt config (installation) - cables, tray partitions DSL 11 BROOKHAVEN SCIENCE

Component applications 12 BROOKHAVEN SCIENCE

Cabling applications 13 BROOKHAVEN SCIENCE

14 BROOKHAVEN SCIENCE

15 BROOKHAVEN SCIENCE

16 BROOKHAVEN SCIENCE

17 BROOKHAVEN SCIENCE

EPICS Extensions • EPICS core extensions • • • Client specified filtering for rate limiting, dead bands, and sub arrays. State record primitive to provide modular solution to motion and multistate devices such as valves that need to capture transition times and timeouts. New modular interface to event generator and event receiver C++ Implementation of PVAccess servers to serve V 3 databases Control System Studio – User Interface Tools • • • Adopted CSS for our user interface after evaluation Redeveloped build environment and had it adopted by the collaboration Developed a name server to return process variables by function Developed a channel access package to provide all client functions and time synchronous vectors from an arrays of process variables. Developed multichannel visualization tools 18 BROOKHAVEN SCIENCE

CSS Tools Adopted - Probe, pvtree 19 BROOKHAVEN SCIENCE

CSS Tools Adopted - Data Browser • Plot ‘live’ and historic data over time (combination of striptool and archive viewer) 20 BROOKHAVEN SCIENCE

CSS Tools Adopted - BOY • BOY is an Operator Interface (OPI) development and runtime environment. 21 BROOKHAVEN SCIENCE

CSS Tools Adopted - BOY • BOY runtime environment/example OPI screens 22 BROOKHAVEN SCIENCE

Developed Tools - Channel. Finder Viewer • Used to search for channels by name, • properties tags. Sort, filter tag channels 23 BROOKHAVEN SCIENCE

Developed Tools - Multi channel Viewer § Same set of channels § § Fig 1. sorted by position Fig 2. sorted by name 24 BROOKHAVEN SCIENCE

Subsystem Status • • Subsystem Responsibilities • Timing Joe Delong, Jayesh Shah • Diagnostics Yong Hu, Kiman Ha, and Huijuan Xu (Steve Hunt) • Power Supplies Yuke Tian, Shweta Saraf • Vacuum equipment Huijuan Xu • Equipment Protection System David Dudley • Personnel Protection System David Dudley • RF Joe Delong, Michael Davidsaver • Beam Line Control Daron Chabot, Wayne Lewis • Insertion Device Control Daron Chabot, Wayne Lewis • Facility Control Sheng Peng • Network / File Servers Robert Petkus • Physics Application Guobao Shen, Nikolay Malitsky Preliminary Design Complete for all machine subsystems. Good progress on beam line control. Prototypes are under development and continue to verify requirements are met. Final Design will include: • Extended Preliminary design to include: – Final hardware selection – Software packages identified and specified • Complete Component Type definitions in IRMIS • Complete signal counts completed 25 BROOKHAVEN SCIENCE

Subsystem Test Stands Network Design Complete Core switches ordered ($320 K) Vacuum Lab Diagnostics File Se. Vacrver and c. PCI crate Application Fast Digitizers Timing Hardware Soft IOCs Test Stand IRMISPPS Test Stand Test Redundant Monitor w/ Raid Disks Radiation Servers Acquisition Test Stand EPS Image Motion Control Test Stand 26 BROOKHAVEN SCIENCE

Subsystem Standards (1 of 2) • • • Application Development Environment – Established in Mercurial Naming Convention • established early by project management • distributed responsibility Component types and installed components to be documented through IRMIS Equipment standards (developed with each group): Timing – established Micro Research Finland as standard Diagnostics – standard for each class of problem Vacuum – standard interfaces for serial devices being determined. Equipment Protection System –Allen-Bradley and Siemens standard for PLCs established and in use for all project PLCs, We integrate PLC data into EPICS Personnel Protection System – Siemens and Allen-Bradley Safety PLC selected. We implement B chain. RF – controllers are under development. Not yet integrated. Turnkey contracts include statements to use the standards as defined in each subsystem by NSLS II. 27 BROOKHAVEN SCIENCE

Subsystem Standards (2 of 2) • • • • VME Crates – two vendors that we are evaluating: Elma and Weiner c. PCI Crates – under evaluation Soft IOCs – Linux servers – same as used for control room applications. Processors – Motorola and Intel processors being evaluated PLCs – Allen Bradley chosen as standard – putting together standard component list • External vendors have Siemens as an option. Timing – Micro Research Finland latest series chosen Camera – Proscilica with Gig. E interface chosen Fill Pattern – Acqiris chosen. DCCT has GE digitizer under evaluation. Cell controller – First spin operational – Ready for spin 2 – moving to Virtex 6 BPMs – First spin operational – Ready for spin 2 - Libera still a backup plan. Power supplies – in house development I chosen – ready for production. Racks are specified by electronics group Switches – Brocade and Juniper under evaluation Core Switches – Brocade chosen – purchase order out. Motion control – Delta Tau and Galil under consideration. Delta Tau meets all requirements. 28 BROOKHAVEN SCIENCE

Conclusions • The cell controller, power supply controller, and beam position monitor digital hardware is all running – A second spin for the DFE will be completed in February – The PSC and PSI are ready for production. – The Cell controller can support 100 microsecond machine protection if needed • The High Level Physics Application architecture is in place and being used as each service and application is prototyped. • The IRMIS tools are well supported by the developers and have gained acceptance outside of the control group. – Management support is strong to assure success. – An active collaboration is started with FRIB. • Our preliminary designs are complete and final designs are started for all subsystems except beam line controls. • We are ahead of schedule in prototyping all subsystems in order to provide timely decisions on hardware and software standards. • The control team has established critical mass and has very strong momentum. 29 BROOKHAVEN SCIENCE