Difference between revisions of "Run Planning Meeting Notes, July 07 - July 14, 2022"

From GlueXWiki
Jump to: navigation, search
(Created page with " Back to Run Coordination Meetings:Summer2022 Meeting are via ZoomGov: [https://jlab-org.zoomgov.com/j/1601990060?pwd=TUtwTGszMFg5bjhwdC9nU0IvREUzZz09 connect] (Meeting I...")
 
(→‎Reports)
 
(66 intermediate revisions by 2 users not shown)
Line 8: Line 8:
  
 
[https://docs.google.com/spreadsheets/d/1sdluzy7p5vnlhw9AWJHBrYbXKTBet45o4den4zWX9dc/edit#gid=1855021251 Spreadsheet with list of runs]
 
[https://docs.google.com/spreadsheets/d/1sdluzy7p5vnlhw9AWJHBrYbXKTBet45o4den4zWX9dc/edit#gid=1855021251 Spreadsheet with list of runs]
−
= July 6 =
 
−
=== Past 24 hours ===
 
−
* production data taking continued on Pb
 
−
* serious DAQ issues early afternoon. Sergey worked hard to fix. Started initially with rocFDC11 busy causing DAQ to hang. after necessary reboot of roctrig1 the trig_client process on gluon100 stopped communicating with roctrig1 so no trigger rate data went to EPICS anymore. see [https://logbooks.jlab.org/entry/4011604 logbook]
 
−
* life time variation are still an issue at times.
 
−
* Richard tested TAGM results from HV scan. [https://logbooks.jlab.org/entry/4011487 New Thresholds for TAGM] tested ok and loaded
 
−
* quite smoth data taking over night.
 
−
* new timing calibrations in the TAGGER look good but there are some [https://logbooks.jlab.org/entry/4011594 "bumps/shoulders/backgrounds"]
 
−
* after beam went away, start ramping the solenoid down for cyro compressor switch.
 
  
−
=== Shift reports ===
 
−
* [https://logbooks.jlab.org/entry/4011688 day shift summary]
 
−
* [https://logbooks.jlab.org/entry/4011389 swing shift summary]
 
−
* [ owl shift summary]
 
−
* [ early riser shift summary]
 
  
−
=== Reports ===
+
= Wednesday July 13 =
−
* B
+
  
−
=== Issues ===
 
−
* Sean found that the TOF RF signal is mssing since run 100477: see [https://logbooks.jlab.org/entry/4011333 logbook] Our check procedures are clearly not vigilant enough anymore. RF signals are NOT in online monitoring anymore and Hydra is not doing its job as intended.
 
−
* switching back from AMO to Diamond the cross hair on the camera does not match the position with the Diamond. However beam seems to be in the right spot as there is a coeherent peak in the tagger microscope with the expected rates as well as the DAQ rates make sese. see [https://logbooks.jlab.org/entry/4011571 lobook]
 
−
 
−
=== Plans ===
 
−
* maintenance day: beam will go away 7:30am, 8 hours maintenance, followed by beam restoration and high current beam tuning for HallC
 
−
** please access hall after 9am: other halls have priority
 
−
** ramp solenoid to 800A for cyro comprssor swtch
 
−
** FCAL base replacement
 
−
** Tagger NMR inspection
 
−
** Fix TOF RF signal
 
−
 
−
= Tuesday July 5 =
 
 
=== Past 24 hours ===
 
=== Past 24 hours ===
−
* established operating field of solenoid just shortly before 12 noon. First regular production run on Pb 100862
+
* Production on lead (~2.7B events)
−
* blast from the past, [https://logbooks.jlab.org/entry/4010961 TDC timing shifts] by 32ns this time in a BCAL slot
+
* trigger changed around 10 pm, first run with the updated trigger 101033
−
* [https://logbooks.jlab.org/entry/4010964 tagger micr. RF shift] by 2ns in run 100864, in fact both tagh and tagm are off w.r.t RF by about 2ns: [https://logbooks.jlab.org/entry/4010968 see here].
+
−
* Beam profiler removed from beam
+
−
* owl shift is very successful taking data.
+
  
−
=== Shift reports ===
+
=== Shift Reports ===
−
*[https://logbooks.jlab.org/entry/4010866 day shift summary]
+
* [https://logbooks.jlab.org/entry/4014366 Day shift summary]
−
*[https://logbooks.jlab.org/entry/4010953 swing shift summary]
+
* [https://logbooks.jlab.org/entry/4014514 Swing shift summary]
−
*[https://logbooks.jlab.org/entry/4011041 owl shift summary]
+
* [https://logbooks.jlab.org/entry/4014653 Owl shift summary]
−
*[https://logbooks.jlab.org/entry/4011117 early riser shift summary]
+
* [https://logbooks.jlab.org/entry/4014735 Early Riser shift summary]
  
 
=== Reports ===
 
=== Reports ===
−
* [https://logbooks.jlab.org/entry/4010862 Beam Profile June 30] early morning and later evening when beam came back
+
* Trigger has been modified [https://logbooks.jlab.org/entry/4014639]
−
* [https://logbooks.jlab.org/entry/4011200 straight track running]
+
* Scans (7.30 pm [https://logbooks.jlab.org/entry/4014607], 9 pm [https://logbooks.jlab.org/entry/4014628])
 +
* Collimator scan (Hovanes)[https://logbooks.jlab.org/entry/4014610] (result [https://logbooks.jlab.org/entry/4014619], xtrapolation [https://logbooks.jlab.org/entry/4014657]); MWPC was tripping(?)
 +
* Beam asym. monitor. fixed [https://logbooks.jlab.org/entry/4014793]
 +
* Slight improvement in Y-position stability [logentry from Matt Mock https://logbooks.jlab.org/entry/4014665]
 +
* Night beam strip chart [https://logbooks.jlab.org/entry/4014730]
 +
 
 
=== Issues ===
 
=== Issues ===
−
* there are some indications that the location of the coherent peak is not that stable. during a phone call with HallD we observed the coherent edge move from a too high location to the nominal location over the course of about 30 seconds. This correspond, according to the shift leader, to the HallC beam coming on. Hmmmm. star date around 04 Jul 2022 06:21:46 PM EDT
 
−
* [https://logbooks.jlab.org/entry/4011029 beam shifts/drifts can be significant]
 
−
* occasional life time drops in the DAQ is still happening.
 
−
* some very noisy CDC channels: [https://logbooks.jlab.org/entry/4011141 see logbook entry 4011141]
 
  
 
=== Plans ===
 
=== Plans ===
−
* TDB: continue taking production data on Pb target.
+
* Switch to empty target this afternoon
−
* MCC discusses plans for Machine improvements. Current idea is to have a "maintenance" day tomorrow, while doing RF recovery the injector wien power supplies will be exchanged as the y-component seems to be a source of a 60Hz intensity modulation seen in the beam at higher currents at the level of 10%.
+
* RF Recovery Thursday (beam down 8.15 till ~5pm)
−
* Tomorrow Wednesday 7:30 beam is taken away for MAINTENANCE DAY estimate 8h + beam restoration.
+
  
−
= Monday July 4 =
+
= Tuesday July 12 =
−
after switching back to Pb "full" target data taking till the thunderstorm passing though knocked out our power supply and and the solenoid ramped down.
+
−
changing plans and switch to strait track running.
+
  
 
=== Past 24 hours ===
 
=== Past 24 hours ===
−
* beam was trippy but ok and we were taking data on Pb
+
* David Lawrence acting RC for 24hr (hand back to Ilya late this afternoon)
−
* at 3:23pm a thunderstorm knocked out our solenoid: [https://logbooks.jlab.org/entry/4010550 solenoid trip], [https://logbooks.jlab.org/entry/4010553 cooling water glitch]
+
* >2.5B events
−
* took action to prepare for strait track running over night with solenoid field off
+
* mostly production running with some trigger work
−
* solenoid power supply  and magnet all trips reset and is ready for ramp of if need be. seed [https://logbooks.jlab.org/entry/4010571 solenoid status after dump]
+
−
* prepare for strait track running, take some raw mode data and then move to 50M triggers strait tracks
+
−
* start ramping magnet back up. at 5:30am reach 800A and decided to take beam back on diamond radiator to continue data taking.
+
−
* Solenoid at nominal field at 11:52am
+
  
−
=== Shift reports ===
+
=== Shift Reports ===
−
* [https://logbooks.jlab.org/entry/4010404 day shift summary]
+
* [https://logbooks.jlab.org/entry/4013902 Day shift summary]
−
* [https://logbooks.jlab.org/entry/4010586 swing shift summary]
+
* [https://logbooks.jlab.org/entry/4014061 Swing Shift Summary 07-11-22], [https://logbooks.jlab.org/entry/4014071 Remote Shift Worker Swing 7/11/22]
−
* [https://logbooks.jlab.org/entry/4010638 owl shift summary]
+
* [https://logbooks.jlab.org/entry/4014180 Owl Shift Summary, July 11]
−
* [https://logbooks.jlab.org/entry/4010732 early riser shift summary]
+
* [https://logbooks.jlab.org/entry/4014251 Shift Summary - Early riser shift 07/12/2022], [https://logbooks.jlab.org/entry/4014250 Remote shift worker Riser]
  
 
=== Reports ===
 
=== Reports ===
−
*[https://logbooks.jlab.org/entry/4010862 Beam Size and Stability] while the beam properties seem to have changed after beam came back on June 30th as seen by the AC, the Beam profiler was put into the beam for the past 24 hours to obtain a clear relation ship between AC asymmetry measurements and Beam Profiles beam positions in x/y [mm]. [https://logbooks.jlab.org/entry/4010870 Beam Profiler Result]
+
* [https://logbooks.jlab.org/entry/4013899 Follow-up Re: Rho polarization as a function of beam energy]
 +
* [https://logbooks.jlab.org/entry/4014028 Asymmetries for JD70-105 0/90 PERP]
 +
* [https://logbooks.jlab.org/entry/4013946 direct correlation between ebeam Y position and currents in FMWPC]
 +
* [https://logbooks.jlab.org/entry/4014137 CPP trigger rate, mask one FCAL ring]
 +
* [https://logbooks.jlab.org/entry/4014167 Extrapolations of today's wire scans]
 +
* [https://logbooks.jlab.org/entry/4014297 Beam RMS at AC July 1 to 11]
 +
* [https://logbooks.jlab.org/entry/4014304 FMWPC hit time distributions look ok]
  
 
=== Issues ===
 
=== Issues ===
−
* solenoid ramping
+
* Beam stability in Y - MCC informed and will address
−
* DAQ lifetime drops and fluctuations are still a reoccurring thing. It is usually accompanied with fluctuating input buffer size.
+
* BCAL/FCAL LED trigger found off
 +
* [https://logbooks.jlab.org/entry/4013856 CPP Chamber gas flow]
 +
** [https://logbooks.jlab.org/entry/4013926 FMWPC currents are back up]
 +
* [https://logbooks.jlab.org/entry/4013859 Pressure on DIRC north barbox corrected]
  
 
=== Plans ===
 
=== Plans ===
−
* once solenoid is at full field continue with production data taking on lead target.
+
* Continue production on lead
 +
* Hold off changing target until after 4pm
 +
* RF Recovery Thursday (beam down)
  
 +
= Friday July 8 - Sunday July 10 =
  
−
= Sunday July 3 =
+
=== Past 72 hours ===
−
Spent 3 shifts on empty target data taking. Rocky start with 3h per setting gradually improved to 2 hours per setting to 1.5h per setting. Over the past 24 hours no beam at all at 45.4%. [https://logbooks.jlab.org/entry/4010376 Beam to the Halls] in the past 36 hours does not look bad but the beam is very trippy.
+
  
−
=== Past 24 hours ===
+
* 6B events on lead have been collected
−
* take data on PB till 10am when beam was off and decision was taken to move to empty target run
+
* FMWPC 1 noise level increased yesterday evening [https://logbooks.jlab.org/entry/4013708],
−
* taking empty target data: goal 1.5B events total PARA,PERP and Amo
+
** Beni noticed the chamber HV might be OFF [https://logbooks.jlab.org/entry/4013790]
−
* data taking on empty ended 3:22am, Ilya came in and changed [https://logbooks.jlab.org/entry/4010300 target back to lead]. Around 3:55am continue with nominal production running on lead.
+
** Gas supply logentry [https://logbooks.jlab.org/entry/4013766]
−
* MCC reports that they encounter again some issues with cavity zone [https://logbooks.jlab.org/entry/4010257 1L10-5]. This is the main source of trips in the past preventing high current to hallC.
+
** MWPC1/4 noise level time progress [https://userweb.jlab.org/~ilarin/cpp/mwpc_occ_degradation.pdf]
 +
 
 +
* DAQ livetime looks much better after switching to writing data in two files simultaneously
 +
* Friday evening harp scan [https://logbooks.jlab.org/entry/4012897] [https://logbooks.jlab.org/entry/4012901] [https://gryphn.phys.uconn.edu/halld/cobrems/harptool_2d.cgi?harp5C11_xsigma=1.293&harp5C11_xsigma_err=0.03&harp5C11_usigma=0.997&harp5C11_usigma_err=0.03&harp5C11_ysigma=1.015&harp5C11_ysigma_err=0.03&harp5C11B_xsigma=1.076&harp5C11B_xsigma_err=0.05&harp5C11B_usigma=0.8206&harp5C11B_usigma_err=0.05&harp5C11B_ysigma=0.931&harp5C11B_ysigma_err=0.15&radHarp_xsigma=1.039&radHarp_xsigma_err=0.02&radHarp_usigma=1.087&radHarp_usigma_err=0.02&radHarp_ysigma=0.8327&radHarp_ysigma_err=0.02&harp5C11_spos=102.97&harp5C11B_spos=115.11&emittance_x=0.0041&radHarp_spos=119.7&emittance_y=0.00233&collimator_spos=194.92&fit=fit+and+plot extrapolation]
 +
* Sunday morning harp scan [https://logbooks.jlab.org/entry/4013474 5C11] [https://logbooks.jlab.org/entry/4013475 5C11B] [https://logbooks.jlab.org/entry/4013479] [https://gryphn.phys.uconn.edu/halld/cobrems/harptool_2d.cgi?harp5C11_xsigma=1.51&harp5C11_xsigma_err=0.03&harp5C11_usigma=1.04&harp5C11_usigma_err=0.03&harp5C11_ysigma=1.181&harp5C11_ysigma_err=0.03&harp5C11B_xsigma=1.165&harp5C11B_xsigma_err=0.05&harp5C11B_usigma=0.8986&harp5C11B_usigma_err=0.05&harp5C11B_ysigma=1.028&harp5C11B_ysigma_err=0.15&radHarp_xsigma=1.141&radHarp_xsigma_err=0.02&radHarp_usigma=1.171&radHarp_usigma_err=0.02&radHarp_ysigma=0.8437&radHarp_ysigma_err=0.02&harp5C11_spos=102.97&harp5C11B_spos=115.11&emittance_x=0.0041&radHarp_spos=119.7&emittance_y=0.00233&collimator_spos=194.92&fit=fit+and+plot extrapolation]
 +
* Hall-D strip charts
 +
** Friday [https://logbooks.jlab.org/entry/4013160 Beni]
 +
** Saturday [https://logbooks.jlab.org/entry/4013403 Simon]
 +
** Sunday [https://logbooks.jlab.org/entry/4013591 Arshak]
  
 
=== Shift reports ===
 
=== Shift reports ===
−
*[https://logbooks.jlab.org/entry/4009967 day shift summary]
+
* [https://logbooks.jlab.org/entry/4012676 Friday day shift summary]
−
*[https://logbooks.jlab.org/entry/4010072 swing shift summary]
+
* [https://logbooks.jlab.org/entry/4012861 Friday swing shift summary]
−
*[https://logbooks.jlab.org/entry/4010202 owl shift summary]
+
* [https://logbooks.jlab.org/entry/4012952 Friday owl shift summary]
−
*[https://logbooks.jlab.org/entry/4010300 early riser shift summary]
+
* [https://logbooks.jlab.org/entry/4013044 Saturday early riser shift summary]
 +
* [https://logbooks.jlab.org/entry/4013166 Saturday day shift summary]
 +
* [https://logbooks.jlab.org/entry/4013264 Saturday swing shift summary]
 +
* [https://logbooks.jlab.org/entry/4013337 Saturday owl shift summary]
 +
* [https://logbooks.jlab.org/entry/4013408 Sunday early riser shift summary]
 +
* [https://logbooks.jlab.org/entry/4013486 Sunday day shift summary]
 +
* [https://logbooks.jlab.org/entry/4013580 Sunday swing shift summary]
 +
* [https://logbooks.jlab.org/entry/4013649 Sunday owl shift summary]
 +
* [https://logbooks.jlab.org/entry/4013717 Monday early riser shift summary]
  
 
=== Reports ===
 
=== Reports ===
−
*[https://logbooks.jlab.org/entry/4009918 Monitoring plot Run 100825] last run before switch to empty
+
* New high voltages were loaded for FCAL [https://logbooks.jlab.org/entry/4012655]
−
*[https://logbooks.jlab.org/entry/4010104 Monitoring plot Run 100830] during empty target data taking
+
* Hovanes has updated AMO radiator position [https://logbooks.jlab.org/entry/4012808]
−
*[https://logbooks.jlab.org/entry/4010320 Monitoring plot Run 100844]  after empty target, Pb back in beam.
+
  
 
=== Issues ===
 
=== Issues ===
−
* Hydra does not seem to display plots: [https://logbooks.jlab.org/entry/4010106 logbook entry]. This seems to be related to root_spy not running correctly, it shows the processes up and running but no events being actually processed. Restarting the process seem to solve the issue but it seems this restart does not work on any arbitrary gluon machine. For example the first attempt of restart on gluon48 directly did not work but doing the same action on gluon05 did work.
+
* Tagger NMR communication will be worked out this week (Tim) [https://logbooks.jlab.org/entry/4012702]
−
* However, Hydra seems to not display on gluon machines in the counting house while on a "private" laptop accessing from outside Jlab it works.
+
* Beam instability in y [https://logbooks.jlab.org/entry/4013571 Beni]
−
* DAQ life time drops are still happening. [https://logbooks.jlab.org/entry/4010300 rate fluctuations in grafana], [https://logbooks.jlab.org/entry/4010202 owl shift]
+
  
 
=== Plans ===
 
=== Plans ===
−
* taking production data on lead.
+
* Continue production on lead
 +
* unmask FCAL modules in the trigger
 +
 
 +
 
 +
= Thursday July 7 =
  
−
= Saturday July 2 =
 
−
Yesterday: No beam during the day. Beam back after 4pm, taking data over night.
 
 
=== Past 24 hours ===
 
=== Past 24 hours ===
−
* beam taken away by MCC around 10am for beam studies and high current development to hallC
+
 
−
* Access to hall by Tim to move Pb target slightly off center to position frame in beam. Taking data in this configuration was abandoned since there will be no beam still swing shift. Ilya went back to the hall and put the Pb target [https://logbooks.jlab.org/entry/4009574 back into nominal position]
+
* harp scans were done during short beam on period during day-time, some distributions show 1/100 peak/shoulders ratio others 1/10,000 [https://logbooks.jlab.org/entry/4012157] [https://logbooks.jlab.org/entry/4012169]
−
* postpone the target "off-position" test to a later time with more beam reliability.
+
* Dominion Power's work required a voltage reduction so we had tagger, PS and sweep magnets off for a couple of hours
−
* around 4:20pm beam is back, first do harp scans and the proceed with production data taking on Pb target.
+
* collected cosmics and LED runs during daytime, and production on lead (about 8 hrs) during night time
−
* taking data was generally ok with the intermittent issue of beam trips and persistent DAQ buffer issues.
+
* Beni: beam was quite stable overnight [https://logbooks.jlab.org/entry/4012625]
−
* shift crew uses "Buffer Depth" indicator of the DAQ to take action on stopping/restarting a run to battle lifetime issues.
+
−
* DAQ life time during owl shift is generally good
+
−
* early riser shift continues with data taking. The DAQ seems to behave somewhat but still hicks up form time to time.
+
−
* [https://logbooks.jlab.org/entry/4009935 Hall Beam Currents over night]
+
  
 
=== Shift reports ===
 
=== Shift reports ===
−
*[https://logbooks.jlab.org/entry/4008732 day shift summary]
+
* [https://logbooks.jlab.org/entry/4012170 day shift summary]
−
*[https://logbooks.jlab.org/entry/4009606 swing shift summary]
+
* [https://logbooks.jlab.org/entry/4012365 swing shift summary]
−
*[https://logbooks.jlab.org/entry/4009740 owl shift summary]
+
* [https://logbooks.jlab.org/entry/4012468 owl shift summary]
−
*[https://logbooks.jlab.org/entry/4009854 early riser shift summary]
+
* [https://logbooks.jlab.org/entry/4012564 early riser shift summary]
  
 
=== Reports ===
 
=== Reports ===
−
* The accidental scaling factor for run [https://logbooks.jlab.org/entry/4009493 100767] is around 1.08 which is somewhat higher than during regular GlueX running but comparable to PrimeX running.
+
* Sasha checked FCAL trigger rate without masking inner layers. Preliminary result for the rate was  14kHz [https://logbooks.jlab.org/entry/4012436]
−
* Naomi identified some [https://logbooks.jlab.org/entry/4009597 CDC noisy channels] requiring some threshold change.
+
* Hovanes pointed out, that we don't observe 60Hz oscillations now [https://logbooks.jlab.org/entry/4012466]
  
 
=== Issues ===
 
=== Issues ===
−
* Request to any target movement/change: Report the change in the logbook with a picture of the "flag"-target-indicator and beam line
+
* Problems with running at 30nA on AMO, radiator thickness was reduced to 3*10^-4 this night,
−
* the NMR probe for the TAGGER magnet is operational again providing reasonable data.
+
as 4.5*10^-4 was causing IOC trips [https://logbooks.jlab.org/entry/4012504] [https://logbooks.jlab.org/entry/4012514]
 +
* Alexandre just noticed that  Tagger magnet NMR communication is down again [https://logbooks.jlab.org/entry/4012611]
 +
* DIRC major alarm has been acknowledged [https://logbooks.jlab.org/entry/4012485], Mark may need to investigate this issue more
 +
* Dave has noticed we have a higher radiation level values now, about factor of 1.5 [https://logbooks.jlab.org/entry/4012423], [https://logbooks.jlab.org/entry/4012426]
 +
* Hydra alarm on fa125_itrig [https://logbooks.jlab.org/entry/4012288]
 +
* daq livetime is uneven from time to time [https://logbooks.jlab.org/entry/4012631]
  
 
=== Plans ===
 
=== Plans ===
−
* start taking empty target data this afternoon: one full sequence (PARA,PARA,PERP,PERP,AMO+) + (PARA,PERP) to about  1.5B triggers total
+
* Continue production on lead
−
** QUESTION: Do we really want 60nA e-beam current or do we want to be more conservative with 50nA? The issue: rates in the tagger.
+
* find out the way to unmask FCAL modules
 +
 
 +
= Wednesday, July 6 =
  
−
= Friday July 1 =
 
−
Overall a similar day as in the past: no beam during the day with some data taking over night. Generally the beam looked more stable but still lots of trips when HallC beam is on. ([https://logbooks.jlab.org/entry/4009395 Beam in HallD and C]).
 
 
=== Past 24 hours ===
 
=== Past 24 hours ===
−
* start out with no beam. Beam lost due to 1L15. whole day shift needed to replace "bracker" for zone 1L15
+
 
−
* after accelerator repair work, efforts are taken to establish beam in the machine and try to increase beam current for HallC
+
 
−
* Bobby and Ilya entered to hall to investigate the target moving mechanism.
+
* Malte and Mark worked on FCAL bases replacement [https://logbooks.jlab.org/entry/4011757]
−
* Justin rebooted crate U1-1-top to reestablish [https://logbooks.jlab.org/entry/4009191 BCAL LED trigger]
+
* One of the RF crates had been disconnected, Beni fixed it [https://logbooks.jlab.org/entry/4011767]
−
* the magnetic field measurement of the tagger magnet is still [https://logbooks.jlab.org/entry/4009229 not working]. See [https://logbooks.jlab.org/entry/4009005 earlier report]
+
* Bobby and others worked in the tagger hall during the day. At 3:30 pm Bobby noticed that the IOC for the NMR was not responding properly. MCC rebooted the IOC crate. Afterward, it was still locked on zero and there was still a Comm Status error [https://logbooks.jlab.org/entry/4011870]
−
* beam back after 10pm started doing harp scan first: [https://logbooks.jlab.org/entry/4009292 Harp Scan Results]
+
* Beni found that the solenoid controls hung, and restarted the ramping, which was helpful.
−
* shift crew was not able to write halld scan pictures into logbook: see [https://logbooks.jlab.org/entry/4009276 owl shift summary]
+
* Had minor issues with DAQ at 7.00 pm: ROCFDC11 error: timeout error on FA125, every 3 seconds. (fADC125 in fdc11 slot 3 was replaced during daytime [https://logbooks.jlab.org/entry/4011797]) Sergei worked out the DAQ issue at 7.50 pm
−
* take first data with Amo radiator on goniometer and then production with diamond. pretty much very time a runs was restarted the life time was bad and the DAQ required full restart.
+
* Established operating field of the solenoid at 8:30 pm.
−
* the beam position on the AC may be more stable in then in the past: requires closer look
+
* harp scans are ongoing now
−
* the DAQ liftime keeps posing issues: [https://logbooks.jlab.org/entry/4009358 DAQ lifetime monitoring]
+
−
* from [https://logbooks.jlab.org/entry/4009337 Epics Overview] all looks ok, the rates in the very low tagger energy counters are low, but the scale of the high rates counters dominates the plot. But maybe the rates in those counter may in fact be dominated by scraping? -> needs closer look see also [https://logbooks.jlab.org/entry/4009112 report from Hovanes on harp scans]
+
−
* Beam positions at AC seem to be more stable and variations smaller than in the past: [https://logbooks.jlab.org/entry/4009420 beam positions in halld]
+
  
 
=== Shift reports ===
 
=== Shift reports ===
−
*[https://logbooks.jlab.org/entry/4009095 day shift summary]
+
* [https://logbooks.jlab.org/entry/4011688 day shift summary]
−
*[https://logbooks.jlab.org/entry/4009196 swing shift summary]
+
* [https://logbooks.jlab.org/entry/4011901 swing shift summary]
−
*[https://logbooks.jlab.org/entry/4009276 owl shift summary]
+
* [https://logbooks.jlab.org/entry/4011988 owl shift summary]
−
*[https://logbooks.jlab.org/entry/4009355 early riser shift summary]
+
* [https://logbooks.jlab.org/entry/4012045 early riser shift summary]
  
 
=== Reports ===
 
=== Reports ===
−
* low invariant mass +/- pair tracks are indeed leptons: [https://logbooks.jlab.org/entry/4009188 E/p vs Mass] (and mostly electron/positrons!)
 
−
* Monitoring proposal for CPP signal: [https://logbooks.jlab.org/entry/4009446]
 
−
* target position mechanism and small variations:<br> [[File:screen1.jpeg|100px]]
 
−
* [https://logbooks.jlab.org/entry/4009158 BCAL Gain studies] over the current run period by M.D. For most sensors these look reasonable. Some outlier due to hardware changes.
 
  
−
=== Issues ===
+
* Sergey and Lubomir worked in the Hall this night from 10 pm to 11:30 pm [https://logbooks.jlab.org/entry/4011999]
−
* tagger NMR probe not operational,[https://logbooks.jlab.org/entry/4009229 TAGGER NMR]. The magnet itself is controlled by MCC
+
* Hovanes reported his study of the coherent peak position drifts observed on the 4th of July [https://logbooks.jlab.org/entry/4011805]
−
* DAQ issues with low life time seems to happen more frequently affecting almost every stop/start run action. The lifetime drop seems to happen mostly when starting a new run, not so much during a run (my interpretation from the logbook).
+
* Still have 60Hz structure [https://logbooks.jlab.org/entry/4012003]. The situation is improved according to MCC experts.
−
* Two pre-amp cards in the CDC may have developed [https://logbooks.jlab.org/entry/4009367 more noise]
+
* CDC HV and TAGM alarms are more frequent now
−
 
+
* CDC gas flow increased [https://logbooks.jlab.org/entry/4012075]
−
=== Plans ===
+
−
* maximum 2 hour beam test with target in "wrong" position to assess the issue of different DAQ/count rates after the TAC run period
+
−
* TDB longer term schedule for the whole of the long week end
+
−
** take 12 hours (calendar time) "empty" target data nested between "full" target data taking over the course of the long week end
+
−
 
+
−
= Thursday June 30=
+
−
=== Past 24 hours ===
+
−
Overarching theme of the past 24 hours: "herding cats"
+
−
* no beam during the day, machine optimization to deliver high current beam to HallC (unsuccessful)
+
−
* beam back around 5:30pm
+
−
* did first two Harp scans with HallD laser on and off while hallC had around 17uA of beam
+
−
** [https://logbooks.jlab.org/entry/4008902 Scan One with our beam]
+
−
** [https://logbooks.jlab.org/entry/4008909 Scan Two only HallC beam]
+
−
** [https://logbooks.jlab.org/entry/4008895 Scan results at collimator]
+
−
** peak to base line of the harp peaks is about 100 (as in previous scans)
+
−
** [https://logbooks.jlab.org/entry/3954427 OLD harp scan from Dec 1 2021] and [https://logbooks.jlab.org/entry/3954917 Dec 2 2021]
+
−
* general beam conditions are rather unstable. [https://logbooks.jlab.org/entry/4008917 beam strip chart]
+
−
* continue data taking over night
+
−
* DAQ issues again with life time dropping to 60%. Shift crew called Sergey.  
+
−
** found problem with Slot 3 fiber 7 having trouble (I think this is seen in roctrig1?)
+
−
** after Sergey's intervention DAQ came slowly back to "normal"
+
−
* beam conditions are very unstable over night
+
−
* [https://logbooks.jlab.org/entry/4009005 Loss of NMR comm in Tagger Manet ]
+
−
* again very bad life time 10% only! (stopped run 100778) but also beam lost beam at the same time.
+
−
** stopping and restarting the DAQ with new run 100779 cured the issue of low lifetime, but soon beam was lost again.
+
−
* beam on and off for some time, finally off with problems in several cavities one whole (1L15) zone no beam for several hours.
+
−
 
+
−
=== Shift reports ===
+
−
* [https://logbooks.jlab.org/entry/4008732 day shift summary]
+
−
* [https://logbooks.jlab.org/entry/4008832 swing shift summary]
+
−
* [https://logbooks.jlab.org/entry/4008952 owl shift summary]
+
−
* [https://logbooks.jlab.org/entry/4009018 early riser shift summary]
+
−
=== Reports ===
+
−
* invariant mass of pi+pi- tracks: [https://logbooks.jlab.org/entry/4008817 Vertex VS M(pi+pi-)]
+
−
** follow up [https://logbooks.jlab.org/entry/4009076 Energy, Trigger Bit]
+
  
 
=== Issues ===
 
=== Issues ===
−
* HallD beam conditions(e,gamma): quality/stability
+
* Hovanes pointed out that something strange happened during solenoid ramping up [https://logbooks.jlab.org/entry/4011909] [https://logbooks.jlab.org/entry/4012078]
−
** Tuned beam and CW beam to hallD looks different [https://logbooks.jlab.org/entry/4008950 ELOG entry]
+
−
* HallC beam high current not reached, current reached 30uA
+
  
 
=== Plans ===
 
=== Plans ===
−
* MCC: Machine needs to replace "breaker" in 1L15
+
* Continue production on lead
−
** last time this work took about 6 hours
+
* Unmasking FCAL central modules from the trigger needs to be done unless it increases rate too high
−
** NL and SL to be taken down
+
−
** take this opportunity to assess relocation of some BLM in the machine
+
−
* expect beam no earlier then swing shift.
+
−
* CPP/NPP: TBD
+
−
** first do harp scans when beam comes back
+
−
** do first an Amo run using goniometer Al radiator if that does not work due to ion chamber try target ladder Al radiator.
+
−
** continue nominal production data taking on diamond.
+

Latest revision as of 08:33, 13 July 2022

Back to Run Coordination Meetings:Summer2022

Meeting are via ZoomGov: connect (Meeting ID: 160 199 0060 / Passcode 8394)

MCC whiteboard

Hall D counting room white board

Spreadsheet with list of runs


Wednesday July 13

Past 24 hours

  • Production on lead (~2.7B events)
  • trigger changed around 10 pm, first run with the updated trigger 101033

Shift Reports

Reports

Issues

Plans

  • Switch to empty target this afternoon
  • RF Recovery Thursday (beam down 8.15 till ~5pm)

Tuesday July 12

Past 24 hours

  • David Lawrence acting RC for 24hr (hand back to Ilya late this afternoon)
  • >2.5B events
  • mostly production running with some trigger work

Shift Reports

Reports

Issues

Plans

  • Continue production on lead
  • Hold off changing target until after 4pm
  • RF Recovery Thursday (beam down)

Friday July 8 - Sunday July 10

Past 72 hours

  • 6B events on lead have been collected
  • FMWPC 1 noise level increased yesterday evening [9],
    • Beni noticed the chamber HV might be OFF [10]
    • Gas supply logentry [11]
    • MWPC1/4 noise level time progress [12]

Shift reports

Reports

  • New high voltages were loaded for FCAL [16]
  • Hovanes has updated AMO radiator position [17]

Issues

  • Tagger NMR communication will be worked out this week (Tim) [18]
  • Beam instability in y Beni

Plans

  • Continue production on lead
  • unmask FCAL modules in the trigger


Thursday July 7

Past 24 hours

  • harp scans were done during short beam on period during day-time, some distributions show 1/100 peak/shoulders ratio others 1/10,000 [19] [20]
  • Dominion Power's work required a voltage reduction so we had tagger, PS and sweep magnets off for a couple of hours
  • collected cosmics and LED runs during daytime, and production on lead (about 8 hrs) during night time
  • Beni: beam was quite stable overnight [21]

Shift reports

Reports

  • Sasha checked FCAL trigger rate without masking inner layers. Preliminary result for the rate was 14kHz [22]
  • Hovanes pointed out, that we don't observe 60Hz oscillations now [23]

Issues

  • Problems with running at 30nA on AMO, radiator thickness was reduced to 3*10^-4 this night,

as 4.5*10^-4 was causing IOC trips [24] [25]

  • Alexandre just noticed that Tagger magnet NMR communication is down again [26]
  • DIRC major alarm has been acknowledged [27], Mark may need to investigate this issue more
  • Dave has noticed we have a higher radiation level values now, about factor of 1.5 [28], [29]
  • Hydra alarm on fa125_itrig [30]
  • daq livetime is uneven from time to time [31]

Plans

  • Continue production on lead
  • find out the way to unmask FCAL modules

Wednesday, July 6

Past 24 hours

  • Malte and Mark worked on FCAL bases replacement [32]
  • One of the RF crates had been disconnected, Beni fixed it [33]
  • Bobby and others worked in the tagger hall during the day. At 3:30 pm Bobby noticed that the IOC for the NMR was not responding properly. MCC rebooted the IOC crate. Afterward, it was still locked on zero and there was still a Comm Status error [34]
  • Beni found that the solenoid controls hung, and restarted the ramping, which was helpful.
  • Had minor issues with DAQ at 7.00 pm: ROCFDC11 error: timeout error on FA125, every 3 seconds. (fADC125 in fdc11 slot 3 was replaced during daytime [35]) Sergei worked out the DAQ issue at 7.50 pm
  • Established operating field of the solenoid at 8:30 pm.
  • harp scans are ongoing now

Shift reports

Reports

  • Sergey and Lubomir worked in the Hall this night from 10 pm to 11:30 pm [36]
  • Hovanes reported his study of the coherent peak position drifts observed on the 4th of July [37]
  • Still have 60Hz structure [38]. The situation is improved according to MCC experts.
  • CDC HV and TAGM alarms are more frequent now
  • CDC gas flow increased [39]

Issues

  • Hovanes pointed out that something strange happened during solenoid ramping up [40] [41]

Plans

  • Continue production on lead
  • Unmasking FCAL central modules from the trigger needs to be done unless it increases rate too high
Retrieved from "https://halldweb.jlab.org/wiki/index.php?title=Run_Planning_Meeting_Notes,_July_07_-_July_14,_2022&oldid=114270"