Forward Calorimeter Shift

FCAL High Voltage channel with purple border

• Communications problems with the FCAL voltage on a base will be indicated by a purple border around a channel on the FCAL voltage GUI.
  • You might be able to fix the channel
  • Please look at FCAL voltage GUI every couple of hours or so.

The purple border might be caused by:

1. A base lockup
   • Follow FCAL Base lockup procedure
2. A base that has a general communications issue
   • Must be fixed by expert

FCAL Base lockup procedure

Bases might lose communication and stop providing high voltage due to radiation.

Lockup diagnosis:

1. The scalers show zero counts for the channel (the RootSpy occupancy may also show a hole.)
2. The voltage GUI has a purple border for the channel indicating alarm
3. The alarm state is "INVALID, LINK ALARM"
   1. Click on the channel in the voltage screen to get the FCAL Table: Single Channel screen
   2. Hover over the yellow Chanel Status indicator
   3. Mouse tooltip shows the alarm state as "INVALID, LINK ALARM"
   4. If this instead shows "OK, OK" then the base is not locked up

This is corrected by the following sequence:

1. End the run. We usually don't end a run early for this issue.
2. Turn off the high voltage to the whole FCAL.
3. Run the script. "/home/hdops/FCAL/tools/FCAL_basePowerReset.py"
4. Wait for 30 seconds.
5. Reload the production HV settings by clicking on "Save/Restore" -> "Restore FCAL HV Setpoints", then select the top entry called "ProductionHV_CURRENT.snap". Click "Restore"
6. Turn on the FCAL high voltage.
7. Start a new run (as appropriate).
8. MAKE A LOG ENTRY with the number of the locked up base.
9. Some bases will not receive the set point after the reset. Follow the set point not received procedure below.

• 

  Figure: FCAL voltage showing 2 alarm channels

• 

  Figure: FCAL scalers showing 2 missing channels

• 

  Figure: FCAL channel showing a communication failure alarm

• 

  Figure: FCAL occupancy in RootSpy showing 2 missing channels

FCAL High Voltage channel with yellow border

• Voltage problems with the FCAL voltage on a base will be indicated by a yellow border around a channel on the FCAL voltage GUI.
  • You might be able to fix the channel

The yellow border might be caused by:

1. A base that did not receive the voltage set point communication
   • By nudging the voltage you can fix this (follow the set point not received procedure below)
2. A failing base (anything that is none of the above)
   • Must be fixed by expert on a maintenance day

Set point not received procedure

Any time the voltages in the FCAL are reset there will be some bases that do not receive the voltage set point. Epics is slow, it might take 10 minutes before this becomes clear.

• These are diagnosed by clicking on the channel to bring up the Single Channel screen.
  1. If the Voltage Setpoint and the Voltage Setpoint Readback are similar but the Measured Voltage is near to 0, this is likely to be a missed communication between the IOC and the base. This can be corrected by forcing an updated voltage set point communication with that base :
     1. On the channel with issues begin lowering the voltage by clicking on the Voltage Setpoint arrows. After about 20 V of change the Measured Voltage should jump to the correct value.
     2. Do this for all channels with issues.
     3. NB: Restore the voltages using CSS -> FCAL Voltages -> SAVE/RESTORE -> Restore FCAL HV Setpoints -> ProductionHV_CURRENT.snap

High Voltage Expert

Below is a brief explanation of the other functionality capable on the non-expert GUI, but a shift taker must be directed by an expert to use any of the following:

• Enable HV on all bases
  • Click 'All FCAL HV' and select 'Turn On All Bases'
• Disable the HV on all bases
  • Can be done in 2 ways:
    1. At the top of the screen there is a red outline area with 'Turn OFF ALL' written, click the 'HV' button to power off all bases,
    2. click 'All FCAL HV' and select 'Turn Off All Bases'
• Save HV setpoints
  • Click 'SAVE/RESTORE' and select 'Save FCAL HV Setpoints'

Forward Calorimeter Summary

Fig. 1. FCAL during construction, view looking downstream

The hall D Forward Calorimeter (FCAL) is an electromagnetic calorimeter designed to detect neutrals in the forward direction from approximately 2-11 degrees in lab theta, measuring from the center of the target.

The Forward Calorimeter is a 2800 element lead glass detector consisting of 4cm x 4cm x 45cm bars. The light produced in each element is measured using FEU 84-3 PMTs. The PMTs are powered using custom Cockcroft-Walton bases and operate up to 1800 V. The entire detector exists inside an environmentally controlled and light-tight "darkroom" on the FCAL platform. Individual PMTs respond differently to a fixed voltage, so each channel has an independent voltage setting determined from a gain balancing procedure.

The FCAL expert page can be found here. It contain more detailed information if you want a more detailed description of FCAL elements and operation.

Interlocks

Fig. 2. FCAL Darkroom GUI page

A set of "interlocks" monitor the status inside the darkroom and are set to shut off power to bases and PMTs should these exceed set limits. This is mostly done to protect PMTs from potential damage from too much ambient light. There are sensors for the darkroom double doors and four sensor boxes in the darkroom. Each sensor box monitors temperature, humidity, and light levels.

Power supplies for the bases are interlocked and will be turned off when any of the following occurs:

1. both doors to the dark room are open simultaneously,
2. environmental sensors (light, temperature or humidity) in the dark room exceed preset limits or
3. there is a loss of power.

Should the interlock system trip, an expert should be called to reset the condition. Changes to the interlock settings are only allowed by an expert, or under his/her guidance.

Routine operation

FCAL Occupancies

FCAL occupancies will likely have a small number of features to them. Isolated channels may have no/low occupancy (or more rarely very high occupancy). This may vary run-to-run a little bit. This type of behavior doesn't require notifying FCAL experts.

Any behavior other than the above should be reported to FCAL experts. A typical occupancy plot from Spring '17 is shown here:

FCAL EPICS GUI Screens

• FCAL Voltages: This screen gives information on FCAL bases providing power to PMTs. This gives an overview of the FCAL HV status, can be used to power channels on/off, and to navigate to individual channels. Red channels have been turned off by FCAL experts. Yellow channels indicate either voltage or communication issues. Problematic channels will most likely line up with holes in occupancy.
• FCAL Darkroom: This gives an overview of sensors monitoring the environment inside the FCAL darkroom. These should always be green unless someone is inside the darkroom.
• FCAL LED pulser: The long and short term behavior of the FCAL is monitored by an LED pulser and controlled here. This should always be running at 10 Hz and cycles between three different colors hourly. If no LED pulser appears to be going, contact an FCAL expert. Do not change anything here unless you know what you are doing!
• FCAL Scalars: This gives fADC scalar readouts from the FCAL for individual channels.

FCAL Alarms

Dark room

Potential FCAL alarms could come from environmental monitors inside the FCAL darkroom. However, it is not expected that we should ever reach any alarm values. The FCAL Darkroom environmental variables can be viewed using MyaViewer and selecting the group 'HD_FCAL_ROOM'

Expert personnel

The individuals responsible for checking that the FCAL is ready to take data and setting its operating parameters are shown in following table. Problems with normal operation of the FCAL should be referred to those individuals and any changes to their settings must be approved by them. Additional experts may be trained by the system owner and their name and date added to this table.

Table: Expert personnel for the FCAL system

Name	Number	Date of qualification
Calorimeter Expert	354-9399
Mark Dalton	Cell:757-849-2929
Malte Albrecht	Cell:757-316-4936