Difference between revisions of "Run Planning Meeting Notes, July 14 - July 20, 2022"
From GlueXWiki
(→Shift Reports) |
(→Reports) |
||
(85 intermediate revisions by 2 users not shown) | |||
Line 8: | Line 8: | ||
[https://docs.google.com/spreadsheets/d/1sdluzy7p5vnlhw9AWJHBrYbXKTBet45o4den4zWX9dc/edit#gid=1855021251 Spreadsheet with list of runs] | [https://docs.google.com/spreadsheets/d/1sdluzy7p5vnlhw9AWJHBrYbXKTBet45o4den4zWX9dc/edit#gid=1855021251 Spreadsheet with list of runs] | ||
+ | |||
+ | = Wednesday July 20 = | ||
+ | |||
+ | === Past 24 hours === | ||
+ | |||
+ | * [https://logbooks.jlab.org/entry/4017435 FCAL FADC250 replaced] | ||
+ | * [https://logbooks.jlab.org/entry/4017475 Changed to Empty Target] (Ilya) | ||
+ | * Production on Empty Target 60 nA (~0.4 B events) | ||
+ | * Evening showers dropped beam about 7 pm. Arc 3 Power Supply died (in service building that overheated this weekend) | ||
+ | * [https://logbooks.jlab.org/entry/4017706 1 am: No beam for the night] | ||
+ | * [https://logbooks.jlab.org/entry/4017730 Solenoid ramp down started] (Tim) | ||
+ | * [https://logbooks.jlab.org/entry/4017747 Accelerator Maintenance Day]. Swap in spare box supply ~ 8 hrs. | ||
+ | |||
+ | === Shift Reports === | ||
+ | * [https://logbooks.jlab.org/entry/4017431 Day shift summary] | ||
+ | * [https://logbooks.jlab.org/entry/4017575 Swing shift summary] | ||
+ | * [https://logbooks.jlab.org/entry/4017671 Owl shift summary] | ||
+ | * [https://logbooks.jlab.org/entry/4017723 Early Riser shift summary] | ||
+ | |||
+ | === Reports === | ||
+ | * [https://logbooks.jlab.org/entry/4017400 FCAL Flash250 Replaced] (Karthik). Thanks to Chris Stanislav, Sergey and Mark Dalton for fixing the problem. | ||
+ | * [https://logbooks.jlab.org/entry/4017369 Translation Table rocfdc11 slot 3->19] (Justin) | ||
+ | * [https://logbooks.jlab.org/entry/4017533 Update on pi0 peak] (Beni) | ||
+ | * [https://logbooks.jlab.org/entry/4017550 Trigger rates with empty target] (Yannic) | ||
+ | * [https://logbooks.jlab.org/entry/4017767 Trigger with missing FCAL module] (Sasha) | ||
+ | |||
+ | === Issues and Features === | ||
+ | * Add the TOF and CTOF trigger rates to EPICs/archiver | ||
+ | * [https://logbooks.jlab.org/entry/4017357 Tagger Hodoscope channels turned off] | ||
+ | * [https://logbooks.jlab.org/entry/4017713 FMWPC gas low], [https://logbooks.jlab.org/entry/4017721 gas changed out], [https://logbooks.jlab.org/entry/4017733 status], [https://logbooks.jlab.org/entry/4017742 bottles changed out] | ||
+ | |||
+ | === Plans === | ||
+ | |||
+ | * Accelerator maintenance day. | ||
+ | ** Ramp down solenoid to 0 A to do cryogenic maintenance. (Tim coordinating with Jonathan Creel) | ||
+ | ** Investigation of ROCFDC11 Slot 19 FADC125? | ||
+ | ** Investigate FMWPC gas supply? | ||
+ | ** [https://logbooks.jlab.org/entry/4017006 FCAL bases maintenance] | ||
+ | ** [https://mailman.jlab.org/pipermail/halld/2022-July/000996.html Safety Walkthrough at 12:30 pm]. Sign up. | ||
+ | ** Take Harp Scans. Solenoid should be back 7-8 pm. | ||
+ | ** Continue running with Empty Target | ||
+ | |||
+ | = Tuesday July 19 = | ||
+ | |||
+ | === Past 24 hours === | ||
+ | |||
+ | * Production on Full Pb target 30 nA (~2.8 B events) | ||
+ | * At noon ROCFDC11 Slot 19 failed to respond and Sergey took the module out of the configuration. A hall access was not able to fix the problem. (Issue is ongoing) | ||
+ | * At about 2 am, Flas250 module in FCAL died. Chris Stanislav replaced it at about 7:30 this morning. Sergey is getting DAQ back up. | ||
+ | * [https://cebaf.jlab.org/files/ops/accboard/ MCC whiteboard] - Maintenance Day on Wednesday | ||
+ | |||
+ | === Shift Reports === | ||
+ | * [https://logbooks.jlab.org/entry/4016998 Day shift summary] | ||
+ | * [https://logbooks.jlab.org/entry/4017085 Swing shift summary] | ||
+ | * [https://logbooks.jlab.org/entry/4017205 Owl shift summary] | ||
+ | * [https://logbooks.jlab.org/entry/4017283 Early Riser shift summary] | ||
+ | |||
+ | === Reports === | ||
+ | * [https://logbooks.jlab.org/entry/4016986 Web browser with hodps] | ||
+ | * [https://logbooks.jlab.org/entry/4017188 Reconstruction observations] (Sean) | ||
+ | |||
+ | === Issues and Features === | ||
+ | * Add the TOF and CTOF trigger rates to EPICs/archiver | ||
+ | * [https://logbooks.jlab.org/entry/4012390 Translation table for rocfdc11] (Justin) | ||
+ | * ROCFDC11 FADC125 slot19 problems (Sergey) | ||
+ | * [https://logbooks.jlab.org/entry/4017263 FCAL FADC250 board died] | ||
+ | * [https://logbooks.jlab.org/entry/4017266 Example monitoring plots] Physics distributions may be compromised. | ||
+ | |||
+ | === Plans === | ||
+ | |||
+ | * Production data on Full Pb target | ||
+ | * Accelerator will do a 1 hr test plan at 10 am. | ||
+ | * Change to Empty Target | ||
+ | * Tomorrow: | ||
+ | ** Safety Walkthrough at 12:30 pm | ||
+ | ** Investigation of ROCFDC11 Slot 19 FADC125? | ||
+ | ** Possible ramp down of solenoid to 800 A to do cryogenic maintenance. | ||
+ | |||
+ | = Monday July 18 = | ||
+ | |||
+ | === Past 24 hours === | ||
+ | |||
+ | * Production on Full Pb target 30 nA (~3.4 B events) | ||
+ | * Hall C now running at 65 uA. Total beam trips 16/hr, RF trips 10/hr, which is fairly good. | ||
+ | * [https://cebaf.jlab.org/files/ops/accboard/ MCC whiteboard] - Maintenance Day on Wednesday | ||
+ | * Doug: Request for schedule update is in progress. Official approval underway; no issues expected. | ||
+ | |||
+ | === Shift Reports === | ||
+ | * [https://logbooks.jlab.org/entry/4016647 Day shift summary] | ||
+ | * [https://logbooks.jlab.org/entry/4016734 Swing shift summary] | ||
+ | * [https://logbooks.jlab.org/entry/4016802 Owl shift summary] | ||
+ | * [https://logbooks.jlab.org/entry/4016872 Early Riser shift summary] | ||
+ | |||
+ | === (Proposed) Guidelines === | ||
+ | * Half-wave plate changes: End the current run. Make a separate log entry indicating new position of HWP (in/out). Start a new run | ||
+ | * Day shift: Check FMWPC gas pressure. Make a separate log entry with current pressure. | ||
+ | |||
+ | === Reports === | ||
+ | * [https://logbooks.jlab.org/entry/4016676 Current Statistics for CPP-NPP Run] (Albert) | ||
+ | * [https://logbooks.jlab.org/entry/4016924 Beam position stability on AC] (Beni) | ||
+ | * [https://logbooks.jlab.org/entry/4016671 pi0 update] (Beni) | ||
+ | * [https://logbooks.jlab.org/entry/4016921 Rate monitoring] (Alexandre) | ||
+ | * [https://logbooks.jlab.org/entry/4016405 Last 3 fa125 itrig errors occurred at event 199961. Go figure.] (Naomi) | ||
+ | |||
+ | === Issues and Features === | ||
+ | * Stability of beam position at Active Collimator | ||
+ | * Add the TOF and CTOF trigger rates to EPICs/archiver | ||
+ | * [https://logbooks.jlab.org/entry/4016899 DAQ windows not updating until window is selected] | ||
+ | * [https://logbooks.jlab.org/entry/4016770 FCAL Base lockup] | ||
+ | * [https://logbooks.jlab.org/entry/4012390 Translation table for rocfdc11] (Justin) | ||
+ | |||
+ | === Plans === | ||
+ | |||
+ | * Production data on Full Pb target | ||
+ | * Decide when to go to Empty Target | ||
= Sunday July 17 = | = Sunday July 17 = | ||
Line 13: | Line 128: | ||
=== Past 24 hours === | === Past 24 hours === | ||
− | * Production on Full Pb target 30 nA (~ | + | * Production on Full Pb target 30 nA (~2.1 B events) |
+ | * Hall C is now running at 65 uA. | ||
+ | * Accelerator problems in the evening | ||
+ | ** Evening temperatures impacted cooling in building #38 (South Linac - east end). Supplementary cooling was added and stabilized the situation, but facilities may need to help with additional cooling. The are indicators of challenges of running through the summer. | ||
+ | ** Thunderstorms affect operation; root causes are not known. Possible causes (Jay): 1. u-phonics induced by the thunderstorms, C-100 cryomodules not adequately damped for 10-80 Hz vibrations, coupled to waveguides to upstairs. 2. Imperfect grounding. 3. micros electrical discharges affecting low level RF. 4. Long helix master RF cable running to south linac in water-filled trough. | ||
=== Shift Reports === | === Shift Reports === | ||
Line 19: | Line 138: | ||
* [https://logbooks.jlab.org/entry/4016409 Swing shift summary] | * [https://logbooks.jlab.org/entry/4016409 Swing shift summary] | ||
* [https://logbooks.jlab.org/entry/4016462 Owl shift summary] | * [https://logbooks.jlab.org/entry/4016462 Owl shift summary] | ||
− | * [ Early Riser shift summary] | + | * [https://logbooks.jlab.org/entry/4016545 Early Riser shift summary] |
=== Reports === | === Reports === | ||
− | * | + | * [https://logbooks.jlab.org/comment/reply/1089411 CDC pressure drifts] |
=== Issues and Features === | === Issues and Features === | ||
* Stability of beam position at Active Collimator | * Stability of beam position at Active Collimator | ||
* Add the TOF and CTOF trigger rates to EPICs/archiver | * Add the TOF and CTOF trigger rates to EPICs/archiver | ||
+ | * (Minor) DAQ problems Early Riser Sat, Owl Sunday | ||
=== Plans === | === Plans === | ||
Line 55: | Line 175: | ||
=== Reports === | === Reports === | ||
− | * | + | * |
=== Issues and Features === | === Issues and Features === |
Latest revision as of 08:34, 20 July 2022
Back to Run Coordination Meetings:Summer2022
Meeting are via ZoomGov: connect (Meeting ID: 160 199 0060 / Passcode 8394)
Hall D counting room white board
Contents
Wednesday July 20
Past 24 hours
- FCAL FADC250 replaced
- Changed to Empty Target (Ilya)
- Production on Empty Target 60 nA (~0.4 B events)
- Evening showers dropped beam about 7 pm. Arc 3 Power Supply died (in service building that overheated this weekend)
- 1 am: No beam for the night
- Solenoid ramp down started (Tim)
- Accelerator Maintenance Day. Swap in spare box supply ~ 8 hrs.
Shift Reports
Reports
- FCAL Flash250 Replaced (Karthik). Thanks to Chris Stanislav, Sergey and Mark Dalton for fixing the problem.
- Translation Table rocfdc11 slot 3->19 (Justin)
- Update on pi0 peak (Beni)
- Trigger rates with empty target (Yannic)
- Trigger with missing FCAL module (Sasha)
Issues and Features
- Add the TOF and CTOF trigger rates to EPICs/archiver
- Tagger Hodoscope channels turned off
- FMWPC gas low, gas changed out, status, bottles changed out
Plans
- Accelerator maintenance day.
- Ramp down solenoid to 0 A to do cryogenic maintenance. (Tim coordinating with Jonathan Creel)
- Investigation of ROCFDC11 Slot 19 FADC125?
- Investigate FMWPC gas supply?
- FCAL bases maintenance
- Safety Walkthrough at 12:30 pm. Sign up.
- Take Harp Scans. Solenoid should be back 7-8 pm.
- Continue running with Empty Target
Tuesday July 19
Past 24 hours
- Production on Full Pb target 30 nA (~2.8 B events)
- At noon ROCFDC11 Slot 19 failed to respond and Sergey took the module out of the configuration. A hall access was not able to fix the problem. (Issue is ongoing)
- At about 2 am, Flas250 module in FCAL died. Chris Stanislav replaced it at about 7:30 this morning. Sergey is getting DAQ back up.
- MCC whiteboard - Maintenance Day on Wednesday
Shift Reports
Reports
Issues and Features
- Add the TOF and CTOF trigger rates to EPICs/archiver
- Translation table for rocfdc11 (Justin)
- ROCFDC11 FADC125 slot19 problems (Sergey)
- FCAL FADC250 board died
- Example monitoring plots Physics distributions may be compromised.
Plans
- Production data on Full Pb target
- Accelerator will do a 1 hr test plan at 10 am.
- Change to Empty Target
- Tomorrow:
- Safety Walkthrough at 12:30 pm
- Investigation of ROCFDC11 Slot 19 FADC125?
- Possible ramp down of solenoid to 800 A to do cryogenic maintenance.
Monday July 18
Past 24 hours
- Production on Full Pb target 30 nA (~3.4 B events)
- Hall C now running at 65 uA. Total beam trips 16/hr, RF trips 10/hr, which is fairly good.
- MCC whiteboard - Maintenance Day on Wednesday
- Doug: Request for schedule update is in progress. Official approval underway; no issues expected.
Shift Reports
(Proposed) Guidelines
- Half-wave plate changes: End the current run. Make a separate log entry indicating new position of HWP (in/out). Start a new run
- Day shift: Check FMWPC gas pressure. Make a separate log entry with current pressure.
Reports
- Current Statistics for CPP-NPP Run (Albert)
- Beam position stability on AC (Beni)
- pi0 update (Beni)
- Rate monitoring (Alexandre)
- Last 3 fa125 itrig errors occurred at event 199961. Go figure. (Naomi)
Issues and Features
- Stability of beam position at Active Collimator
- Add the TOF and CTOF trigger rates to EPICs/archiver
- DAQ windows not updating until window is selected
- FCAL Base lockup
- Translation table for rocfdc11 (Justin)
Plans
- Production data on Full Pb target
- Decide when to go to Empty Target
Sunday July 17
Past 24 hours
- Production on Full Pb target 30 nA (~2.1 B events)
- Hall C is now running at 65 uA.
- Accelerator problems in the evening
- Evening temperatures impacted cooling in building #38 (South Linac - east end). Supplementary cooling was added and stabilized the situation, but facilities may need to help with additional cooling. The are indicators of challenges of running through the summer.
- Thunderstorms affect operation; root causes are not known. Possible causes (Jay): 1. u-phonics induced by the thunderstorms, C-100 cryomodules not adequately damped for 10-80 Hz vibrations, coupled to waveguides to upstairs. 2. Imperfect grounding. 3. micros electrical discharges affecting low level RF. 4. Long helix master RF cable running to south linac in water-filled trough.
Shift Reports
Reports
Issues and Features
- Stability of beam position at Active Collimator
- Add the TOF and CTOF trigger rates to EPICs/archiver
- (Minor) DAQ problems Early Riser Sat, Owl Sunday
Plans
- Production data on Full Pb target
Saturday July 16
Past 24 hours
- Production on Empty target 60 nA (~1.1 B events)
- Hall Access
- Inserted Pb target (Ilya)
- Changed one FCAL base (Malte/Mark)
- Switched SD boards between FDC crates 11 and 12 (Cody/Ben)
- Harp Scans
- Production on Full Pb target 30 nA (~2.1 B events)
Shift Reports
Reports
Issues and Features
- FA125 itrig errors R101072, SD cards swapped FA125 itrig errors R101076
- Stability of beam position at Active Collimator
- Add the TOF and CTOF trigger rates to EPICs/archiver
Plans
- Production data on Full Pb target
Friday July 15
Past 24 hours
- RF Recovery Day
- Productive Recovery
- Slow orbit drifts investigated. Source: changing up of a screen. Longterm solution will be implemented with long shutdown, requires vacuum work. Short-term: increase apertures, possibly this weekend.
- Restoring to more stable configuration. Delivered 70 uA to Hall C for short period and ran 48 uA overnight.
- RF trips at about 13 trips/hr.
- Maintenance
- Access to investigate DIRC environment parameters (Nick)
- Access to install crystals for testing in the PS Test Setup (Vlad and Sasha)
- DIRC Environment (Tim)
- Recycled power on BCAL LED crate (Elton/Mark)
- FCAL Base Replaced (Malte/Mark]
- Program when beam comes back
- Solenoid ramped up to 1350 A (Tim)
- Beam back about 9 pm.
- Production on Empty target 30 nA (~0.08 B events)
- Production on Empty target 60 nA (~1 B events)
Shift Reports
Reports
- Single pi0 production (Beni)
- omega signal in FCAL (Simon)
Issues and Features
- Stability of beam position at Active Collimator
- itrigger errors in monitoring plots
- Hydra not running (Naomi)
- Add the TOF and CTOF trigger rates to EPICs/archiver
Plans
- Need about 6 hours to complete present cycle on empty target.
- Insert Full Target Pb (mid afternoon)
- Change SD card in FDC crate if Cody is available.
- Harp scans
- Production
Thursday July 14
Past 24 hours
- Request for a Schedule Adjustment from Jul 27 to Aug 17 has been submitted.
- Production on Full Pb target (~0.5 B events)
- Install Empty Target (12 pm)
- Production on Empty Target (~0.9 B events). Need about twice that. After checking statistics today, I suggest we stay on Empty Target, but run at 60 nA after maintenance.
- Storm Takes Down Accelerator
- Smooth, but trippy, beam after recovery. Trips are at about 15-20 trips/hr
Shift Reports
Reports
- We would like to add the TOF and CTOF trigger rates to EPICs/archiver
Plans
- RF Recovery today (beam down 8.15 till ~5pm)
- HD Refrigerator Maintenance
- Access for Sasha and Vlad to install modules in PS Test Stand
- Nick to work on DIRC environment
- Following Maintenance: Plan to continue with Empty Target data to complete the data taking cycle and then continue at 60 nA