Electronics PDR PALM-3000 Stephen Guiwits Dean Palmer Ernest

Electronics PDR PALM-3000 Stephen Guiwits Dean Palmer Ernest Croner 023 Robinson Room January 21, 2009

PALM-3000 Agenda • Overview – Major sub-systems • • Real-Time Electronics (Computer Room) Active Mirror Electronics (Cassegrain Cage / AO Lab) AO Bench Electronics (Cassegrain Cage / AO Lab) Data Room Electronics (Data Room / AO Lab) Palomar Infrastructure Upgrades Milestones Costs Questions, Comments, or Suggestions 2

PALM-3000 Overview

PALM-3000 • • • Real-Time Control Electronics Design Layout Racks – Make / Model – Capacity • Computing Machines – Make / Model – PCI Cards – Cabling • • Switches – Quadrics – Network – KVM Uninterruptible Power Supply (UPS) – Make / Model 4

PALM-3000 RTC Design • Cluster of 10 PC’s in the computer room • Real-time calculations performed on 16 Nvidia GPU’s • PC 0 provides the interface, central scheduling, and control of the cluster • PC 1 – PC 8 house the GPU’s • PC 9 is dedicated to telemetry recording • Cluster communication provided by the high speed Quadrics switch • 2 complete systems for production and development 5

PALM-3000 • Layout Real-Time Control Electronics

Real-Time Control Electronics PALM-3000 • Racks – Make / Model • Shark Rack • T 2 Base Rack (x 4) • Part Number: T 2 EC 016 -A – Capacity • 42 U (1 U = 1. 75 Inches) • 37 Deep Frame

Real-Time Control Electronics PALM-3000 • Racks – 4 Total • Production / Development – Front Door, Fully Vented – Rear Door, Fully Vented – 42 U Mounting Rails – Fan Top Panel – 19 inch Fixed Shelf w/Adjustable Mounting Brackets • T 2

Real-Time Control Electronics PALM-3000 • Computing Machines – Make / Model • PC 0 – PC 8 – – HP xw 9400 Two Dual Core AMD Opteron 2220, 2. 80 GHz Processors 4 GB (4 x 1 GB) DDR 2 -667 ECC RAM 80 GB SATA 7200 RPM HDD • Telemetry PC – – – HP xw 9400 Two Dual Core AMD Opteron 2212, 2 GHz Processors 32 GB (8 x 4 GB) DDR 20533 ECC 160 GB SATA 10 K RPM HDD NVIDIA Quadro NVS 285 Graphics Card

PALM-3000 Real-Time Control Electronics • Computing Machines – PC 9

PALM-3000 Real-Time Control Electronics • Computing Machines – PC 0 For LGS • UTT • Slot 4 • IP Carrier Card – – Acromag APC 8621 A • D/A – – Acromag IP 231 E

PALM-3000 Real-Time Control Electronics • Computing Machines – PC 1 - 8

Real-Time Control Electronics PALM-3000 • Computing Machines – Cabling • Telemetry PC – – – – Standard power cable to power strip on the rack 1’ Coaxial Cable from timing board to PC 0 s timing board 1’ SC-SC fiber cable from QLogic card to RAID system 3 M Quadrics cable from Quadrics PCI card to Quadrics switch 3 M RJ 45 cable from ethernet 1 to network switch (port 9) 3 M USB cable from USB 1 to KVM switch (port 9) 3 M DVI cable from DVI (graphics card) to KVM Switch (port 9)

Real-Time Control Electronics PALM-3000 • Computing Machines – Cabling • PC 0 – Standard power cable to power strip on the rack – 300’ cross over cable from ethernet port 2 to ethernet port 2 on the cassegrain cage PC (pc <--> pc communication) – 1’ Coaxial Cable from timing board to PC Telem’s timing board – 1 M Camera link cable from EDT PCI card to Sci. Measure Optical Splitter – 3 M Quadrics cable from Quadrics PCI card to Quadrics switch – 3 M RJ 45 cable from ethernet 1 to network switch (port 0) – 3 M USB cable from USB 1 to KVM switch (port 10) – 3 M DVI cable from DVI (graphics card) to KVM Switch (port 10)

PALM-3000 Real-Time Control Electronics • Computing Machines – Cabling • PC 0 (Continued) – 300’ fiber (lc-lc) from Fibre. Extreme port 1 (through cable wrap) to the custom HO DM I/F box located on DM Rack 1 – 300’ fiber (lc-lc) from Fibre. Extreme port 1 (through cable wrap) to the custom HO DM I/F box located on DM Rack 2 – 300’ fiber (lc-lc) from Fibre. Extreme port 2 (through cable wrap) to the custom LO DM I/F box located on DM Rack 2 – 300’ fiber (lc-lc) from Fibre. Extreme port 3 (through cable wrap) to the custom TTM I/F box located on AO Control Rack 2

Real-Time Control Electronics PALM-3000 • Computing Machines – Cabling • PC 1 – PC 8 – Standard power cable to power strip on the rack – 1 M Camera link cable from EDT PCI card to Sci. Measure Optical Splitter – 3 M Quadrics cable from Quadrics PCI card to Quadrics switch – 3 M RJ 45 cable from ethernet 1 to network switch (port ) – 3 M USB cable from USB 1 to KVM switch (port ) – 3 M DVI cable from DVI (graphics card) to KVM Switch (port

PALM-3000 Real-Time Control Electronics

Real-Time Control Electronics PALM-3000 • Switches – Quadrics • Qs. Net II (16 way solution) • 1064 Mbytes/s • 900 MB/S Sustainable – Network • Ether. Fast 4116 16 -Port 10/100 Ethernet Switch • Model Number: EF 4116 – KVM • KVMS 16 port USB DVI KVM Switch • 17 Inch LCD Monitor / Keyboard drawer • Model Number: UNIMUX-DVI-16

Real-Time Control Electronics PALM-3000 • Uninterruptible Power Supply (UPS) – Make / Model • • American Power Conversion Corp (APC) APC AIS 3000 Part Number: ISVT 15 KF 2 B 4 S 18 minutes of uptime Allows for a little expansion if needed Cost: ~11, 000 (if expansion desired) Cost: ~8, 000 (no expansion)

PALM-3000 Active Mirror Control Electronics Active Mirror Electronics 20

Active Mirror Control Electronics PALM-3000 • • Design DM Control – DM High-Speed Data Link • • • HO DM LO DM TTM – DM Drivers • • Cabling Cooling – Liquid • • • Design Hardware Costs – Air • • Design Hardware Costs Rack Locations inside the cassegrain cage 21

Active Mirror Control Electronics PALM-3000 • HODM control through 8 Xinetics Gen. III Driver Chassis each of which can control 480 Channels • LODM control is provided by the existing JPL electronics • Able to fit all DM driver electronics into two full size racks • DM Driver Electronics require cooling – Intend to air cool them the lab during lab development – Air cooled design in place – Developing a liquid cooling design for location at cassegrain cage and AO lab • Two phases of cabling – Phase 1: Lab Development • Use Xinetics provided interface panels with 99 omnetics connectors to the DM – Phase 2: • Build custom interface boxes to 16 custom cables that allow us greater flexibility in location of cables • Provide serial interface to configure and monitor driver states • Provide high speed SOR-422 U interface for DM control 22

PALM-3000 Active Mirror Control Electronics • Provide serial interface to configure and monitor driver states – Currently planning on using a terminal server configuration to communicate with the driver – Xinetics is working on a master/slave configuration which would allow communication with each driver through the master. If this works, we will abandon the terminal server design. • Provide high speed SOR-422 U interface for DM control 23

DM High-Speed Data Link PALM-3000 Transmit End • Curtiss Wright Fibre. Xtreme SL 240 PCIe 2. 5 Gb/s Data Link Card – Up to 247 MB/s per channel sustained data rate per channel – Low overhead ANSI/VITA 17. 1 -2003 Serial FPDP Protocol • Based on Fiber Channel. Uses similar ordered sets – Low latency (about 1 us) – 4 independent channels 24

PALM-3000 DM High-Speed Data Link Receive End • Curtiss Wright Fibre. Xtreme SL 240 CMC 2. 5 Gb/s Data Link Card – IEEE P 1386 Common Mezzanine Card form factor (same as PMC) – 32 -bit parallel FPDP data bus @ 62. 5 MHz • Custom Carrier Board – 6 U VME form factor. FPGA based. –Four SOR-422 U parallel output ports for connection to Xinetics Drivers. –P 1 port for connection to LODM and TTM amplifiers.

PALM-3000 DM High-Speed Data Link Architecture

PALM-3000 Active Mirror Control Electronics I/F panel 16 cables with 375 -pin Hypertronics connectors AO Bench Rack 1 I/F panel I/F box I/F panel 3668 actuator DM I/F panel 99 cables with 51 -pin Omnetics connectors Rack 2 I/F panel

PALM-3000 • Active Mirror Control Electronics HO DM Cabling 28

PALM-3000 • Active Mirror Control Electronics HO DM Cabling 29

PALM-3000 Active Mirror Control Electronics • Layout (Liquid: Rack 1) 30

PALM-3000 Active Mirror Control Electronics • Layout (Liquid: Rack 2) 31

PALM-3000 Active Mirror Control Electronics • Layout (Air: Rack 1) 32

PALM-3000 Active Mirror Control Electronics • Layout (Air: Rack 2) 33

Active Mirror Control Electronics PALM-3000 • Rack locations inside the cassegrain cage – DM racks located in 2 and 3 1 2 West side 3

PALM-3000 AO Bench Electronics 35

PALM-3000 • • • AO Bench Electronics Design Layout Workstation Computer – Make / Model – PCI Cards – Cabling • Motion Control – Make / Models – Cabling • Monster Motor Cable – Design – Cable / Connector – Cost • Rack Locations inside the cassegrain cage 36

PALM-3000 AO Bench Electronics • Two 24 U Bud Industry Racks • Rack mounted PC provides supervisory control for AO bench devices • 4 Motion Controllers • 2 Sci. Measure Controllers (1 NGS) • Light Sources (Laser and White Light) • New Monster Motor Cable • TTM Custom Interface Box 37

PALM-3000 • Layout (Rack 1) AO Bench Electronics

PALM-3000 • Layout (Rack 2) AO Bench Electronics

AO Bench Electronics PALM-3000 • Computer – Make / Model • • • Advanced Industrial Computer RMC-4 S-2 Rack Mount 7 PCI Slots 0 C – 50 C – PCI Cards • PCI IP Carrier Card – Acromag – APC 8621 E 40

AO Bench Electronics PALM-3000 • Computer (Continued) – PCI Cards • Digital I/O – – – IP 470 A 48 bi-directional input/output channels TTL compatible inputs Extended temperature range $425. 00 • Connects to a custom board inside the monster motor cable box which is then routed to a break out box and connected to the white light source. We will re-use the existing hardware and cables. 41

AO Bench Electronics PALM-3000 • Computer (Continued) – PCI Cards • • Engineering Design Team (EDT) PCI DV C-Link Communication with the acquisition camera Direct 5 M camera link cable connection 42

AO Bench Electronics PALM-3000 • Computer (Continued) – Ethernet • Connects to PC 0 via a 300’ crossover cable • Gigabit Ethernet (For Video Data Transfer) • Connection through the Palomar cable wrap 43

AO Bench Electronics PALM-3000 • Motion Control – Make / Models • Aerotech (2) – – – – Ensemble EPAQ 6 Axis RS 232 communication 6 ATS 50 motors (4 for stimulus, 1 for acquisition camera) 1 ATS 100 (Stimulus fold mirror – Replaces current 850 E) 1 ATS 150 (HOWFS focus stage) 4 AOM 130 (SSMs, each with external encoder) 44

AO Bench Electronics PALM-3000 • Motion Control – Make / Models • Newport (2) – – – ESP 300 3 Axis RS 232 communication 2 MFA-CC (HOWFS Lenslet Changer) 1 UTS 50 CC (HOWFS Camera Focus) 2 LTA-HS (Second ESP 300 to support OAR experiment) 45

Motor Cable Interface PALM-3000 Cable Design • We are not planning on reusing the existing cable. – – Not enough conductors. No shielded twisted pairs (desirable for encoder signals). Scheduling conflicts. Note: Could be made to work with secondary power cable and remote sense encoder / limit switch power. • Two Cable Design to separate power signals from low-level signals – Signal Cable (custom made) • 78 26 AWG shielded twisted pairs for encoder signals • 132 26 AWG single conductors for limit switches, hall sensors, etc. • 10 20 AWG single conductors for encoder, limit switch, and camera power • Hypertronics NPJY 23 / 2 HFR/1 NMRR/4 HFR/1 NMRR/2 HRF connectors – Power Cable (custom made) • 20 20 AWG shielded quads for motor power • 8 RG 316 coaxes for PZTs • Hypertronics NPJY 23/13 NMRR/2 VMR connectors 46

PALM-3000 Motor Cable Interface Boxes • Rack Box – – +5 V remote sense P. S. for encoders and limit switches +12 V power supply for acquisition camera D-sub connectors to motor controllers Lemo connectors to TTM Interface • Bench Box – – Distribute +5 V power D-sub connectors to motorized stages Lemo connectors to FSM Hirose connector to acquistion camera

PALM-3000 Motor Cable Interface

AO Bench Electronics PALM-3000 • AO Bench Control Cassegrain Rack Locations – AO bench racks located in 4 and 6 1 2 West side 3

PALM-3000 Data Room Electronics 50

PALM-3000 Data Room Electronics • Design 51

PALM-3000 • Data Room Electronics Make / Model – HP xw 9400 Workstation – 4 GB RAM – $3, 000. 00 • Monitors – HP w 2207 h 22 -inch Widescreen Flat Panel Monitor x 3 – $300. 00 each • UPS – Back-UPS ES – $100. 00 • Mobility – Custom made table that will move between the data room and the AO lab – Already built • Locations – AO Lab – Palomar Data Room 52

PALM-3000 Palomar Upgrades Palomar Infrastructure 53

Palomar Infrastructure Upgrades PALM-3000 • Palomar will require upgrades to handle the P 3 K AO System – Power at cassegrain cage • ~10 k. W – Active cooling at cassegrain and AO Lab (if funded) • • Cooling lines Chiller – Routing of cables • • • RTC – DM fibers RTC – Cassegrain Computer Cables must also run to the AO lab during non telescope time. – Cooling to computer room • RTC System produces a significant amount of heat • Power upgrades (~10 k. W) – Computer room reorganization 54

PALM-3000 Electronics Milestones • RTC procured • Electronics PDR • DM racks integrated 2/25/2008 1/21/2009 1/4/2009 10/29/2009 3/1/2010 4/6/2010 8/10/2010 10/1/2010 – HODM only, air cooled • Control racks integrated – Cass PC, HOWFS, 2 motor controllers • P 3 K closed-loop testbed complete • Pre-ship Review • Production racks and cables integrated – LODM, cable interfaces, stimulus, etc. • PALM-3000 first light 55

PALM-3000 • Costs spreadsheet • Comprehensive list of: – Electronic component – Price – Procured / To be procured Costs

PALM-3000 Questions, Comments, Suggestions