Difference between revisions of "Run Planning Meeting Notes, October 21 - October 27, 2021"

From GlueXWiki
Jump to: navigation, search
(→‎Thursday, October 21)
(→‎Wednesday 27 October)
 
(57 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
<-- [https://halldweb.jlab.org/wiki/index.php/Run_Coordination_Meetings:Summer2021 Summer 2021 RC meetings]
+
<-- [https://halldweb.jlab.org/wiki/index.php/Run_Coordination_Meetings:Summer2021 Summer 2021 RC meetings] [https://cebaf.jlab.org/files/ops/accboard/ MCC whiteboard]
 +
[https://bluejeans.com/660743227 Meeting Bluejeans 660743227]
 +
=Wednesday 27 October=
 +
#Last 24h:
 +
#* The magnet problem was corrected, and BPMs and viewer in the beamline leading towards the tagger were also made functional. 
 +
#* Tuned beam reached Hall D at around 15:40.  After tuning, harp scans and some worries over target temperature, production resumed with ideal target conditions resumed at 19:40.
 +
#* Just before 1am Drew noticed that the beam current had increased to 220nA, so he asked for it to be lowered to 200nA. At 8:15am Naomi noticed that the operators had interpreted this as a request to reduce it to just below 200nA (from the morning meeting slides). At 8:30 Justin called MCC to correct this.
 +
#* [https://logbooks.jlab.org/entry/3933063 FDC chiller tripped]
 +
#* [https://logbooks.jlab.org/entry/3933148 Alcohol bubbler refilled]
 +
#* [https://logbooks.jlab.org/entry/3933132 Beam position stability] [https://logbooks.jlab.org/entry/3933140 note from MCC on locks]
 +
#* Reference plots updated
 +
#Issues:
 +
#* [https://logbooks.jlab.org/entry/3933110 tag H time-shift] [https://logbooks.jlab.org/entry/3933002 4ns time-shift in tag H]
 +
#* [https://logbooks.jlab.org/entry/3933130 tagger time slope] [https://logbooks.jlab.org/files/2021/10/3933130/rs_page16.png the plot]
 +
#* Low energy tagger counters
 +
#* BCAL noise at 10 o'clock
 +
#* Bleedthrough
 +
# [https://halldweb.jlab.org/primexd/run_plan/Run_Plan_Fall_2021.pdf Plan:]
 +
#* Continue production at 200nA with the solenoid on.
 +
#* Since Hall A cannot run at present, we are the priority hall.
 +
#* Hall C BCM calibration Wed.
 +
#* Next RC will be Malte
 +
 
 +
=Tuesday 26 October=
 +
#Last 24h:
 +
#* [https://cebaf.jlab.org/dtm/open-events?event_id=12311 ops event log] [https://logbooks.jlab.org/entry/3932729 PD morning report] Magnet experts found & fixed a small LCW leak. MCC aimed to have beam to all 4 halls by midnight. They did the pass change but were unable to get beam to hall D.  All the diagnostics for the problem magnet looked good.  At just after midnight they gave up trying, will call DC power & magnet people back in the morning. There will be an access at 9am to check that magnet and several other things.  There are dedicated meetings at 1:30 and 3pm.  [https://bluejeans.com/406649861 1:30pm beam transport team meeting] - agenda is Hall D beam delivery  [https://bluejeans.com/569476853 3pm PD's meeting], 'where are we with 4 hall operation?' 
 +
#* Bill & co changed DIRC water
 +
#* [https://logbooks.jlab.org/entry/3932141 Vertex plots with full target]
 +
#* [https://logbooks.jlab.org/entry/3931027 temps of locked-up FCAL bases]
 +
#Issues:
 +
#* BCAL noise at 10 o'clock
 +
#* Bleedthrough
 +
# [https://halldweb.jlab.org/primexd/run_plan/Run_Plan_Fall_2021.pdf Plan:]
 +
#* When the beam is expected back, call Chris Keith to watch the target fill (1h40). Make the usual checks (radiation levels & harp scans) and then continue production at 200nA.
 +
#* Hall C BCM calibration Wed.
 +
#* Hall A is aiming for another configuration change on Friday (might have a problem w SBS magnet).
 +
 
 +
=Monday 25 October=
 +
#By 1:30 will know what the magnet repair plan is.  There is a spare on site.  It would take about 2 weeks to swap.
 +
#Happenings since Friday morning:
 +
#* Everyone seemed optimistic at Friday's morning meeting.
 +
#* Started filling the target a little before 9:30, with Chris Keith watching, and the shift crew here.
 +
#* We went into controlled access so that Tim could go in to do something for CPP.  Sasha also needs to make an access.
 +
#* [https://logbooks.jlab.org/entry/3930361 This looked promising]
 +
#* [https://logbooks.jlab.org/entry/3932124 The problem was isolated to a ground fault in magnet YBBS04.]
 +
#* Shifts are cancelled until Monday 10am.  Monday 10am+ shifts are on standby.  Tuesday shifts remain unaltered.
 +
#* The target has been emptied, the solenoid is still on, and the hall is in power permit.
 +
#Work done:
 +
#Issues:
 +
#* BCAL noise at 10 o'clock
 +
#* Bleedthrough
 +
# [https://halldweb.jlab.org/primexd/run_plan/Run_Plan_Fall_2021.pdf Plan:]
 +
#* VIP visit (NL & Hall B) + arc 7 magnet tests + pass change. 
 +
#* Bill asked about changing DIRC water.
 +
#* When the beam is back, call Chris Keith to watch the target fill & then continue production at 200nA after the usual checks (radiation levels & harp scans)
 +
 
 +
=Friday, October 22=
 +
# Last 24h: Production runs continued smoothly until 2:51pm when an arc magnet tripped. About 7pm the team looking at the power supply found that there was a short in any one of the 42 magnets downstream, they will resume work in the morning. [https://logbooks.jlab.org/entry/3930057 Shifts were cancelled until 9am.]
 +
{| border="0" cellpadding="2"
 +
|[[Image:arc7.png|thumb|x300px|arc 7 trip]]
 +
|}
 +
#* [https://logbooks.jlab.org/entry/3929614 extra PS shielding added on Wednesday]
 +
#* [https://logbooks.jlab.org/entry/3929964 FCAL comms restored]
 +
#* [https://logbooks.jlab.org/entry/3928806 Alarm added on tagger magnet current]
 +
# Remaining issues:
 +
#* BCAL noise at 10 o'clock
 +
#* Bleedthrough
 +
# [https://halldweb.jlab.org/primexd/run_plan/Run_Plan_Fall_2021.pdf Plan:]
 +
#* Call Chris Keith (to watch the target fill). 
 +
#* When the beam is back, continue production at 200nA after the usual checks (radiation levels & harp scans)
 +
#* Continue running with the solenoid on & target full until further notice
 +
#* [https://cebaf.jlab.org/files/ops/accboard/ Pass change for A&B might be deferred to Saturday swing or Sunday day (A->4 pass)]
 +
#* Expect downtime Monday morning for VIP tour, start time TBC probably ~7am.
  
 
=Thursday, October 21=
 
=Thursday, October 21=
 
# Last 24h:
 
# Last 24h:
−
#* No beam from 5:20pm Tuesday until 2am Thurs due to LCW/power problem
+
#* No beam from 5:20pm Tuesday until early am Thurs due to LCW/power problem.  Resumed production ~3:30am.
 +
#* [https://logbooks.jlab.org/entry/3929556 New harp scan] [https://logbooks.jlab.org/entry/3927666 Previous harp scan]
 
#* Work done during the access:
 
#* Work done during the access:
 
#** [https://logbooks.jlab.org/entry/3928644 magnetic field measurements around CCAL]
 
#** [https://logbooks.jlab.org/entry/3928644 magnetic field measurements around CCAL]
Line 9: Line 82:
 
#** [https://logbooks.jlab.org/entry/3928624 faulty FDC chiller replaced]
 
#** [https://logbooks.jlab.org/entry/3928624 faulty FDC chiller replaced]
 
#** [https://logbooks.jlab.org/entry/3928742 rebalanced the server power load on rack 13]
 
#** [https://logbooks.jlab.org/entry/3928742 rebalanced the server power load on rack 13]
−
#** ? position survey CCAL ?
+
#** position survey CCAL
−
#** ? correct shielding at the left (downstream) PS arm ?
+
#** correct shielding at the left (downstream) PS arm
 
# Remaining issues:
 
# Remaining issues:
 
#* [https://logbooks.jlab.org/entry/3929404 Tagger hodoscope time shifts]
 
#* [https://logbooks.jlab.org/entry/3929404 Tagger hodoscope time shifts]
Line 21: Line 94:
 
#* [https://cebaf.jlab.org/files/ops/accboard/ Pass change for A&B Saturday morning (A->4 pass)]
 
#* [https://cebaf.jlab.org/files/ops/accboard/ Pass change for A&B Saturday morning (A->4 pass)]
 
#* Expect downtime Monday morning for VIP tour, start time TBC probably ~7am.   
 
#* Expect downtime Monday morning for VIP tour, start time TBC probably ~7am.   
−
#* Will need another maintenance day before the energy change
+
#* Ops will need another maintenance day before the energy change

Latest revision as of 08:35, 27 October 2021

<-- Summer 2021 RC meetings MCC whiteboard Meeting Bluejeans 660743227

Wednesday 27 October

  1. Last 24h:
    • The magnet problem was corrected, and BPMs and viewer in the beamline leading towards the tagger were also made functional.
    • Tuned beam reached Hall D at around 15:40. After tuning, harp scans and some worries over target temperature, production resumed with ideal target conditions resumed at 19:40.
    • Just before 1am Drew noticed that the beam current had increased to 220nA, so he asked for it to be lowered to 200nA. At 8:15am Naomi noticed that the operators had interpreted this as a request to reduce it to just below 200nA (from the morning meeting slides). At 8:30 Justin called MCC to correct this.
    • FDC chiller tripped
    • Alcohol bubbler refilled
    • Beam position stability note from MCC on locks
    • Reference plots updated
  2. Issues:
  3. Plan:
    • Continue production at 200nA with the solenoid on.
    • Since Hall A cannot run at present, we are the priority hall.
    • Hall C BCM calibration Wed.
    • Next RC will be Malte

Tuesday 26 October

  1. Last 24h:
  2. Issues:
    • BCAL noise at 10 o'clock
    • Bleedthrough
  3. Plan:
    • When the beam is expected back, call Chris Keith to watch the target fill (1h40). Make the usual checks (radiation levels & harp scans) and then continue production at 200nA.
    • Hall C BCM calibration Wed.
    • Hall A is aiming for another configuration change on Friday (might have a problem w SBS magnet).

Monday 25 October

  1. By 1:30 will know what the magnet repair plan is. There is a spare on site. It would take about 2 weeks to swap.
  2. Happenings since Friday morning:
    • Everyone seemed optimistic at Friday's morning meeting.
    • Started filling the target a little before 9:30, with Chris Keith watching, and the shift crew here.
    • We went into controlled access so that Tim could go in to do something for CPP. Sasha also needs to make an access.
    • This looked promising
    • The problem was isolated to a ground fault in magnet YBBS04.
    • Shifts are cancelled until Monday 10am. Monday 10am+ shifts are on standby. Tuesday shifts remain unaltered.
    • The target has been emptied, the solenoid is still on, and the hall is in power permit.
  3. Work done:
  4. Issues:
    • BCAL noise at 10 o'clock
    • Bleedthrough
  5. Plan:
    • VIP visit (NL & Hall B) + arc 7 magnet tests + pass change.
    • Bill asked about changing DIRC water.
    • When the beam is back, call Chris Keith to watch the target fill & then continue production at 200nA after the usual checks (radiation levels & harp scans)

Friday, October 22

  1. Last 24h: Production runs continued smoothly until 2:51pm when an arc magnet tripped. About 7pm the team looking at the power supply found that there was a short in any one of the 42 magnets downstream, they will resume work in the morning. Shifts were cancelled until 9am.
arc 7 trip
  2. Remaining issues:
    • BCAL noise at 10 o'clock
    • Bleedthrough
  3. Plan:

Thursday, October 21

  1. Last 24h:
  2. Remaining issues:
    • Tagger hodoscope time shifts
    • communication with accel. w.r.t. tagger magnet - Paul Vasilauskis (Ops group leader): "I am putting out to my staff to contact the hall if they do need to touch the magnet and am looking into adding wording to the magnet screens"
    • BCAL noise at 10 o'clock
    • Bleedthrough
  3. Plan:
    • When the beam is back continue production at 200nA after the usual checks (radiation levels & harp scans)
    • Continue running with the solenoid on & target full until Friday or later
    • Pass change for A&B Saturday morning (A->4 pass)
    • Expect downtime Monday morning for VIP tour, start time TBC probably ~7am.
    • Ops will need another maintenance day before the energy change
Retrieved from "https://halldweb.jlab.org/wiki/index.php?title=Run_Planning_Meeting_Notes,_October_21_-_October_27,_2021&oldid=108280"