Station Operator support for a GCI VSAT link

Station Operator support for a GCI VSAT link Efren Abaya Head GCI &Networks Operations Unit Operations Section, IDC Division Preparatory Commission for the Comprehensive Nuclear-Test-Ban Treaty Organization Provisional Technical Secretariat Vienna International Centre P. O. Box 1200 A-140 Vienna, AUSTRIA efren. abaya@ctbto. org

Outline of Presentation • • • Mission of the GCI network GCI Performance requirements Technologies & equipment used in the GCI Network Monitoring System GCI Point of Contact – Roles and responsibilities Examples of GCI problems Abstract: The Global Communications Infrastructure (GCI) connects every IMS facility to the IDC with a target annual availability of 99. 5%. Every GCI component is remotely monitored and controlled by the 24 x 7 Network Operations Centre in the USA as well as by PTS staff. There are times when local support is necessary to diagnose a failure condition or to restore GCI service in the most expedient way. This presentation will discuss the ways in which Station Operators can assist the PTS and the GCI Contractor in maintaining or restoring GCI service. Provisional Technical Secretariat Page 2

Mission of the GCI Network CTBT, ARTICLE IV. A, paragraph 14 a “… in cooperation with the State Parties the Technical Secretariat shall, for the purpose of this Treaty: (a) Make arrangements to receive and distribute data and reporting products relevant to the verification of this Treaty in accordance with its provisions, and to maintain a global communications infrastructure appropriate to this task; . . . ” GCI = Global Communications Infrastructure Provisional Technical Secretariat Page 3

GCI Performance Requirements Relevant GCI performance requirements - • Virtual Circuit Availability • VSAT – must be up 99. 5% of the time over any consecutive 365 days Ø total outage time less than 44 hours per year • Terrestrial – 99. 95% over any consecutive 365 days Ø total outage time less than 4. 4 hours per year • Backup Power for AC outage • 2 to 12 hours of UPS power backup Provisional Technical Secretariat Page 4

GCI VSAT link at an IMS station or NDC Other station or NDC equipment Provisional Technical Secretariat Page 5

Typical GCI equipment at IMS station/NDC Provisional Technical Secretariat Page 6

C-band 2. 4 meter VSAT antenna (Prodelin) • ODU (outdoor unit) • BUC (Block Upconverter) • LNB (Low-noise Block Downconverter) • Feedhorn • OMT (Orthomode transducer) Provisional Technical Secretariat Page 7

Ku-band 1. 2 meter VSAT antenna (Prodelin) • • • ODU (outdoor unit) BUC LNB Feedhorn OMT Notice the yellow grounding wire at the bottom of the pole mount Provisional Technical Secretariat Page 8

Traverse Network Management System (NMS) remotely monitors every GCI link Status, Traffic, Round Trip time, Satellite signal quality, UPS power, etc. Provisional Technical Secretariat Page 9

Cooperative arrangements for GCI Operations &Maintenance CTBTO GCI &Network Operations Unit IMS IT & GCI Support Unit & PTS Operations Centre GCI Contractor Ultisat (NOC) GCI Point of Contact (POC) at stations & NDCs • IDC GCI&NO Unit deals with day-to-day performance issues and reporting. • IMS IT&GCI Support Unit deals with installations and infrastructure issues. Provisional Technical Secretariat Page 10

Responsibilities of the GCI Point of Contact (POC) 1. FORMALITIES - the person(s) who communicates at the highest level regarding the GCI link. For example, this POC nominates the other two types of POC and informs the CTBTO of any changes in POC assignments. Communications at this level will be rare. 2. MAINTENANCE - the POC(s) whom we contact for day-to-day issues with the GCI link. For example, this POC might be requested to restart some equipment or check the conditions at the site. This would also be the person whom the GCI Contractor contacts if they need to send their maintenance engineer to the site. • Have more than one person in this position because it is unavoidable that staff have to leave the office from time to time. Normally, this is the same person(s) as the station local operator. 3. SHIPPING ADDRESS - the person that the PTS or the GCI Contractor contacts if some equipment or spare parts need to be shipped to your site. Delivery companies usually require a street address and a telephone number (and if possible a person’s name) to deliver door-to-door. Provisional Technical Secretariat Page 11

Remote Site Maintenance – Examples of tasks on request by the NOC (1/2) Examples of tasks on Request • Report LED and visual status indicators of i. Direct satellite modem, Cisco router, UPS, antenna de-icer if applicable • Verify that cables and connectors are in place; inspect for damage • Inspect the Line of Sight (LOS) of the VSAT dish antenna • Clean the dish antenna and/or feedhorn cover if necessary • Power cycle (reset) equipment • Carry out tests on GCI equipment, such as UPS • Swap out indoor unit, router, BUC/LNB (in some cases) with cold spare unit Provisional Technical Secretariat Page 12

Remote Site Maintenance – Examples of tasks on request by the NOC (2/2) • Verify power connection; check presence of AC/DC power to UPS, UPS battery status • Report (on request) unusual conditions such as ice, snow, heavy rain • Provide access to site for PTS/contractor maintenance personnel • Logistical assistance for travel by PTS or GCI contractor personnel to site • Logistical assistance for shipment of replacement parts to site, or returning spares to GCI Contractor • Assist in renewing VSAT operating license (when requested) • Normally, Ultisat takes care of this silently in the background • Other tasks of a similar nature to the above as requested by the PTS or the GCI Contractor Provisional Technical Secretariat Page 13

Remote Site Maintenance -- Examples of periodic or routine tasks Storage of GCI spares • Provide secure storage for spare GCI equipment (electronics) • Know where spares are kept! Examples of Periodic Tasks • Check the line of sight (LOS) from antenna to satellite; trim trees if applicable • Verify no physical or mechanical damage to GCI equipment and cables • Report if the antenna or platform or mount is unstable or is damaged • Clean the antenna dish, if needed (for example, to remove snow) • Keep GCI documentation available for use of station personnel • Turn antenna de-icer on or off every season Provisional Technical Secretariat Page 14

Causes of GCI communication problems • Breakdown of equipment – router, modem, outdoor unit component, connecting cables and connectors • Loss of AC or DC mains power supply • Frequent power outages shorten the battery life • Maintenance work at a station or NDC • Line of sight (LOS) blockage • Risks to the equipment: • Cutting grass, digging around the antenna, building new structures near the antenna • Vandalism or theft of equipment • Animals – birds, rats, dogs, horses Provisional Technical Secretariat Page 15

Water or moisture in the feedhorn Water droplets weaken the radio signal from the satellite. Inform the NOC if this happens. Send photgraphs. GOOD Provisional Technical Secretariat BAD Page 16

Bird damage to feedhorn cover and IFL cable Feedhorn cover taped to stop entry of water. Recommended first aid: Cover the entire feedhorn with a plastic bag. Damaged IFL cable sheath should be taped to protect against water entry. Provisional Technical Secretariat Page 17

Before and after clearing Line of Sight (LOS) LOS = Line of sight Circle marks where the satellite is in the sky BEFORE AFTER Provisional Technical Secretariat Page 18

Reporting status lights to the NOC Photo or verbal description of the condition of status lights helps the GCI Contractor in troubleshooting. i. Direct modem i. Direct router Cisco router Provisional Technical Secretariat Page 19

Snow on the antenna Water, snow and ice weaken the radio signal from the satellite. Remove the snow, if possible. Inform the NOC if this happens. Provisional Technical Secretariat Page 20

Access problems Inform the NOC if the IMS facility cannot be reached to service the GCI equipment. Provisional Technical Secretariat Page 21

Corrosion of bolts and metal supports at the VSAT antenna – Inform the NOC Denso tape on metal support rod BAD GOOD Minor surface rust is normal Provisional Technical Secretariat Page 22

Rat droppings in failed GCI equipment Provisional Technical Secretariat Page 23

NOC email to POC – Unknown reason From: GCI NOC [mailto: noc_gci@ultisat. com] Sent: 20 June 2012 16: 58 To: noc_gci; + POC addresses Cc: 'gcintt@ctbto. org'; EHD; Raymond Nyamande Subject: GL 01 Link Outage - i. Heat Ticket 435865 Dear Sir/Madam, We have noted an outage at your site. Site Code: GL 01 Outage Time (UTC): 16 Jun 12 23: 51 UTC Ticket Number: 435865 If any of your staff has access to the GCI equipment at the site that can inform us as to why the site is down, we would greatly appreciate it. We appreciate the time that you spend on GCI matters and thank you in advance for your co-operation. Kindly reply to all the email addresses above. Please quote the number displayed in the subject line in all communications about this particular outage. Please be advised we will call you at the phone numbers below during your normal working hours if the site does not clear before then to discuss how we may assist you with this outage. POC Name POC Office Number POC Mobile Number Mr Gibson Mponela +431 26030 0 If any of the above numbers are incorrect, please advise the NOC by replying to all above. Regards, Provisional Technical Secretariat Page 24

NOC email to POC – Weather-related outage From: GCI NOC [mailto: noc_gci@ultisat. com] Sent: 20 June 2012 16: 58 To: noc_gci; + POC addresses Cc: 'gcintt@ctbto. org'; EHD; Raymond Nyamande Subject: GL 01 Link Outage - i. Heat Ticket 435865 Dear Sir/Madam, We have noted an outage at your site. Site Code: GL 01 Outage Time (UTC): 16 Jun 12 23: 51 UTC Ticket Number: 435865 If any of your staff has access to the GCI equipment at the site that can verify that the site is down due to weather conditions in the area, we would greatly appreciate it. We appreciate the time that you spend on GCI matters and thank you in advance for your co-operation. Kindly reply to all the email addresses above. Please quote the number displayed in the subject line in all communications about this particular outage. Please be advised we will call you at the phone numbers below during your normal working hours if the site does not clear before then to discuss how we may assist you with this outage. POC Name POC Office Number POC Mobile Number Mr Gibson Mponela +431 26030 0 If any of the above numbers are incorrect, please advise the NOC by replying to all above. Regards, Provisional Technical Secretariat Page 25

NOC email to POC – Power outage From: GCI NOC [mailto: noc_gci@ultisat. com] Sent: 20 June 2012 16: 58 To: noc_gci; + POC addresses Cc: 'gcintt@ctbto. org'; EHD; Raymond Nyamande Subject: GL 01 Link Outage - i. Heat Ticket 435865 Dear Sir/Madam, We have noted an outage at your site. Site Code: GL 01 Outage Time (UTC): 16 Jun 12 23: 51 UTC Ticket Number: 435865 If any of your staff has access to the GCI equipment at the site that can verify that the site is down due to power, we would greatly appreciate it. We appreciate the time that you spend on GCI matters and thank you in advance for your co-operation. Kindly reply to all the email addresses above. Please quote the number displayed in the subject line in all communications about this particular outage. Please be advised we will call you at the phone numbers below during your normal working hours if the site does not clear before then to discuss how we may assist you with this outage. POC Name POC Office Number POC Mobile Number Mr Gibson Mponela +431 26030 0 If any of the above numbers are incorrect, please advise the NOC by replying to all above. Regards, Provisional Technical Secretariat Page 26

Reporting or responding to a suspected GCI problem • Open an IRS problem report (for a new issue) • http: //irs. gci. ctbto. org needs a GCI connection • IRS client sends an email problem report over Internet • If above two don’t work, send an email problem report to support@ctbto. org and noc_gci@ultisat. com • Include details: • • • Describe the symptoms of the problem as you see it What equipment is affected (specify name or IP address) When it happened, or when it started & stopped (date & time) Is it still happening? The cause of the problem (if you know it) If relevant – Photographs – The current version of IRS does not support attachments therefore pictures should be sent to gcintt@ctbto. org with reference to the Problem Report ID (if there is an open ticket). Provisional Technical Secretariat Page 27

Thank you Provisional Technical Secretariat September. 2015 Page 28