Difference between revisions of "Run Planning Meeting Notes, Mar 21 - Mar 27, 2019"

From GlueXWiki
Jump to: navigation, search
(Monday, Mar. 25 at 08:45)
(Wednesday, Mar. 27 at 08:45)
 
(30 intermediate revisions by the same user not shown)
Line 48: Line 48:
 
#* now in controlled access, RF recovery underway
 
#* now in controlled access, RF recovery underway
 
# Issues
 
# Issues
#* Ongoing issue with CDC HV readback ([https://logbooks.jlab.org/entry/3670885 logbook entry 3670885])
+
#* Ongoing issue with CDC HV readback ([https://logbooks.jlab.org/entry/3670885 logbook entry 3670885], [https://logbooks.jlab.org/entry/3671598 3671598], [https://logbooks.jlab.org/entry/3671943 3671943])
 
#* PS scalers communication issue ([https://logbooks.jlab.org/entry/3670950 logbook entry 3670950])
 
#* PS scalers communication issue ([https://logbooks.jlab.org/entry/3670950 logbook entry 3670950])
#* DAQ interruptions ~1 per shift, recovery is straight-forward ([https://logbooks.jlab.org/entry/3671151 logbook entry 3671151])
+
#* DAQ interruptions ~1 per shift, recovery is straight-forward ([https://logbooks.jlab.org/entry/3671151], [https://logbooks.jlab.org/entry/3671542])
#* Compcal monitoring plots, timing shows double peak
+
#* Compcal monitoring plots, timing shows double peak, considered ok ([https://logbooks.jlab.org/entry/3671757 logbook entry 3671757])
#* Compcal HV communication failure
+
#* Compcal HV communication failure ([https://logbooks.jlab.org/entry/3671849 logbook entry 3671849 around 1:00am])
#* FCal HV communication failure
+
#* FCal HV communication failure ([https://logbooks.jlab.org/entry/3671351 logbook entry 3671351])
#* FCal fadc scalers stop updating
+
#* Individual FCal bases need reset ([https://logbooks.jlab.org/entry/3671386 logbook entry 3671386], [https://logbooks.jlab.org/entry/3671474 resolved here])
#* Accelerator tightens AC lock constraints
+
#* FCal fadc scalers stop updating ([https://logbooks.jlab.org/entry/3671880 logbook entry 3671880])
 
+
#* Accelerator tightens AC lock constraints ([https://logbooks.jlab.org/entry/3671930 logbook entry 3671930])
 
# Reports
 
# Reports
 +
#* Several reference plots for monitoring histograms out of date ([https://logbooks.jlab.org/entry/3671340 logbook entry 3671340])
 
#* Active collimator lock is mostly working, sometimes fights to keep up ([https://logbooks.jlab.org/entry/3671214 logbook entry 3671214])
 
#* Active collimator lock is mostly working, sometimes fights to keep up ([https://logbooks.jlab.org/entry/3671214 logbook entry 3671214])
 
#* Accelerator using machine development time to investigate this effect in Hall D
 
#* Accelerator using machine development time to investigate this effect in Hall D
 
# Today:
 
# Today:
 
#* work on solenoid during 9:00am - 12:00pm, warm-up to begin ([https://logbooks.jlab.org/entry/3670889 logbook entry 3670889])
 
#* work on solenoid during 9:00am - 12:00pm, warm-up to begin ([https://logbooks.jlab.org/entry/3670889 logbook entry 3670889])
#* accelerator  
+
#* accelerator plans to work on Hall D line optics during second half of day shift
 
#Run Plan
 
#Run Plan
 
#* Production running continues
 
#* Production running continues
 
#* Beam studies planned for day shift on Monday
 
#* Beam studies planned for day shift on Monday
 
#* RF Recovery scheduled for Tuesday
 
#* RF Recovery scheduled for Tuesday
 +
 +
== Tuesday, Mar. 26 at 08:45 ==
 +
# Past 24 hours:
 +
#* access day shift on Monday, out at 3:00pm
 +
#* beam restored by 18:30
 +
#* empty-target running continues
 +
# Issues
 +
#* Ongoing problems with dropped communication to CDC HV crate ([https://logbooks.jlab.org/entry/3671943 logbook entry 3671943], [https://logbooks.jlab.org/entry/3671980 crate rebooted])
 +
#* Reboot of CompCal HV crate failed to restore comms, crate is replaced ([https://logbooks.jlab.org/entry/3671980 logbook entry 3671980])
 +
#* Accelerator switched to manual current adjustment overnight, attenuator problems ([https://logbooks.jlab.org/entry/3672307 logbook entry 3672307])
 +
#* Ongoing DAQ issues ([https://logbooks.jlab.org/entry/3672178 logbook entry 3672178])
 +
#* Advice to shift crew
 +
#*# shift summaries are great for overview of what happened during a shift
 +
#*# this summary is NOT a replacement for separate logbook entries related to exceptional conditions or events
 +
#*# PLEASE make separate logbook entries to report ANY SIGNIFICANT ISSUES that come up!
 +
#*# without these, it is difficult to search the record, create follow-up entries, post plots, etc.
 +
# Reports
 +
#* solenoid warm-up underway ([https://logbooks.jlab.org/entry/3671978 logbook entry 3671978])
 +
#* Updated normalized trigger rates history ([https://logbooks.jlab.org/entry/3672059 logbook entry 3672059])
 +
#* Near-line FCAL gains calibration ([https://logbooks.jlab.org/entry/3672065 logbook entry 3672065])
 +
#* Tagger accidentals fraction ([https://logbooks.jlab.org/entry/3672169 logbook entry 3672169])
 +
# Today:
 +
#* machine rf recovery during day shift
 +
#* did we get enough empty target data, are we ready to fill the He target?
 +
# Run Plan
 +
#* Production running continues
 +
 +
== Wednesday, Mar. 27 at 08:45 ==
 +
# Past 24 hours:
 +
#* access day shift on Tuesday, filled the He target, out by 11:40pm
 +
#* beam restored by 13:10, harp scans, running resumes at 13:30
 +
#* He-target filled ([https://logbooks.jlab.org/entry/3672522])
 +
#* running continues
 +
# Issues
 +
#* big changes in beam x position at dump during early morning ([https://logbooks.jlab.org/entry/3672308 logentry 3672308, see IPMAD00C.XPOS])
 +
#* Alexandre explains this as a change in tagger dipole field ([https://logbooks.jlab.org/entry/3672359 logentry 3672359])
 +
#* tagger NMR probe reading was not updating, restored after ioc reset ([https://logbooks.jlab.org/entry/3672433 logentry 3672433])
 +
#* older-model HV crate moved from compcal/dirc to CDC, newer-model HV crate swapped from CDC to compcal/dirc (WHY NO LOG ENTRY?)
 +
#* after startup, discovered TOF HV was not fully on, recovered after ~30min lost ([https://logbooks.jlab.org/entry/3672310 logentry 3672310])
 +
#* AC beam positions seem more stable with improved slow-lock ([https://logbooks.jlab.org/entry/3672599 logbook entry 3672599])
 +
#* tof FADC scalers stopped updating, fixed by ioc reboot ([https://logbooks.jlab.org/entry/3672491 logentry 3672491])
 +
#* occasional HV alarms, reset themselves without intervention ([https://logbooks.jlab.org/entry/3672491 logentry 3672491])
 +
#* dirc alarm, sensor reports water flow stopped, temperature 300 deg! ([https://logbooks.jlab.org/entry/3672654])
 +
# Reports
 +
#* beam energy drifts by ~10 MeV over several hours ([https://logbooks.jlab.org/entry/3672471 logentry 3672471])
 +
#* ccdb translation table is messed up -- recovery underway today
 +
# Today:
 +
#* beam going away at 10:00 for hall C extraction change from 3-pass to 4-pass, expected to take ~3 hours
 +
#* will take access at 10:00 to check on the DIRC water temperature sensor
 +
#* production continues when beam is restored
 +
# Run Plan
 +
#* Production running continues
 +
#* RC change today at 1:30 - new RC is Stuart Fegan

Latest revision as of 08:44, 27 March 2019

Thursday, Mar. 21 at 08:45

  1. Past 24 hours:
    • RF recovery during the day shift
    • Beam recovery delayed due to (1) issue in the injector, resolved by evening, then (2) UPS battery needs replacement in the north linac.
  2. Issues
  3. Reports
  4. Today:
    • Production: 200nA, Al 10-4
  5. Run Plan
    • Production running: when beam returns, check beam conditions as follows:
      1. do harp scans, both accelerator and Hall D radiator
      2. check radiation monitor rates in tagger hall and Hall D
      3. verify transmission in PSC and PS coincidence rates @ 200nA, 1e-4 radiator
    • Beam studies planned for day shift on Monday
    • RF Recovery scheduled for Tuesday

Friday, Mar. 22 at 08:45

  1. Past 24 hours:
    • beam recovery, conditions checked, running resumed.
  2. Issues
  3. Reports
  4. Today:
    • Production: 200nA, Al 10-4
  5. Run Plan
    • Production running continues
    • Beam studies planned for day shift on Monday
    • RF Recovery scheduled for Tuesday

Monday, Mar. 25 at 08:45

  1. Past 72 hours:
    • production running on He target until Sunday 5:30pm
    • continued running on empty target through Monday 8:30am
    • now in controlled access, RF recovery underway
  2. Issues
  3. Reports
    • Several reference plots for monitoring histograms out of date (logbook entry 3671340)
    • Active collimator lock is mostly working, sometimes fights to keep up (logbook entry 3671214)
    • Accelerator using machine development time to investigate this effect in Hall D
  4. Today:
    • work on solenoid during 9:00am - 12:00pm, warm-up to begin (logbook entry 3670889)
    • accelerator plans to work on Hall D line optics during second half of day shift
  5. Run Plan
    • Production running continues
    • Beam studies planned for day shift on Monday
    • RF Recovery scheduled for Tuesday

Tuesday, Mar. 26 at 08:45

  1. Past 24 hours:
    • access day shift on Monday, out at 3:00pm
    • beam restored by 18:30
    • empty-target running continues
  2. Issues
    • Ongoing problems with dropped communication to CDC HV crate (logbook entry 3671943, crate rebooted)
    • Reboot of CompCal HV crate failed to restore comms, crate is replaced (logbook entry 3671980)
    • Accelerator switched to manual current adjustment overnight, attenuator problems (logbook entry 3672307)
    • Ongoing DAQ issues (logbook entry 3672178)
    • Advice to shift crew
      1. shift summaries are great for overview of what happened during a shift
      2. this summary is NOT a replacement for separate logbook entries related to exceptional conditions or events
      3. PLEASE make separate logbook entries to report ANY SIGNIFICANT ISSUES that come up!
      4. without these, it is difficult to search the record, create follow-up entries, post plots, etc.
  3. Reports
  4. Today:
    • machine rf recovery during day shift
    • did we get enough empty target data, are we ready to fill the He target?
  5. Run Plan
    • Production running continues

Wednesday, Mar. 27 at 08:45

  1. Past 24 hours:
    • access day shift on Tuesday, filled the He target, out by 11:40pm
    • beam restored by 13:10, harp scans, running resumes at 13:30
    • He-target filled ([3])
    • running continues
  2. Issues
    • big changes in beam x position at dump during early morning (logentry 3672308, see IPMAD00C.XPOS)
    • Alexandre explains this as a change in tagger dipole field (logentry 3672359)
    • tagger NMR probe reading was not updating, restored after ioc reset (logentry 3672433)
    • older-model HV crate moved from compcal/dirc to CDC, newer-model HV crate swapped from CDC to compcal/dirc (WHY NO LOG ENTRY?)
    • after startup, discovered TOF HV was not fully on, recovered after ~30min lost (logentry 3672310)
    • AC beam positions seem more stable with improved slow-lock (logbook entry 3672599)
    • tof FADC scalers stopped updating, fixed by ioc reboot (logentry 3672491)
    • occasional HV alarms, reset themselves without intervention (logentry 3672491)
    • dirc alarm, sensor reports water flow stopped, temperature 300 deg! ([4])
  3. Reports
    • beam energy drifts by ~10 MeV over several hours (logentry 3672471)
    • ccdb translation table is messed up -- recovery underway today
  4. Today:
    • beam going away at 10:00 for hall C extraction change from 3-pass to 4-pass, expected to take ~3 hours
    • will take access at 10:00 to check on the DIRC water temperature sensor
    • production continues when beam is restored
  5. Run Plan
    • Production running continues
    • RC change today at 1:30 - new RC is Stuart Fegan