Difference between revisions of "Hall Network Specifications"
From GlueXWiki
m |
m |
||
Line 18: | Line 18: | ||
* Some ROC's are only used for control, not DAQ (e.g. BCAL LED Pulser). | * Some ROC's are only used for control, not DAQ (e.g. BCAL LED Pulser). | ||
* ROC's each need an RS232 connection to a terminal server, terminal servers require an Ethernet connection. | * ROC's each need an RS232 connection to a terminal server, terminal servers require an Ethernet connection. | ||
− | * Each terminal server has | + | * Each terminal server has 32 ports. |
* Can run copper RS232 patch cable from one rack area to terminal server in nearby rack area. | * Can run copper RS232 patch cable from one rack area to terminal server in nearby rack area. | ||
* Will eventually need direct fiber link to ROC if max bandwidth > 80 MB/s, assuming 10**8 photons/sec. | * Will eventually need direct fiber link to ROC if max bandwidth > 80 MB/s, assuming 10**8 photons/sec. |
Revision as of 16:20, 14 October 2013
Below we propose a design for fiber connections between the Rack Room and the Hall, and network switch and terminal server placement.
- Elliott Wolin, Mark Dalton
- 14-Oct-2013
Notes
- Based on 10**8 photons/sec, 200 kHz trigger rate, existing L1 rejection algorithm, block=1 mode, no compression.
- Ethernet port counts from Fernando's rack layouts and information from Dave Butler concerning other controls requirements.
- We own about 15 24-port managed switches with 10 GBit/s fiber uplinks, some being used in EEL building and other places.
- Switches can uplink 1.25 GBytes/sec.
- 8-port managed switches with 1 GBit/s fiber uplinks exist.
- Only managed switches (no hubs!) allowed in hall.
- Fibers come in bundles of 12 or 24, 2 fibers needed for one uplink.
- Standard JLab practice is to terminate all fibers in patch panel when bundles installed.
- Bundle/patch panel installation is expensive, can run much cheaper patch fibers from switch in one rack area to patch panel in nearby rack area.
- DAQ crates require two Ethernet connections each, one for the ROC and one for the fan tray.
- Some ROC's are only used for control, not DAQ (e.g. BCAL LED Pulser).
- ROC's each need an RS232 connection to a terminal server, terminal servers require an Ethernet connection.
- Each terminal server has 32 ports.
- Can run copper RS232 patch cable from one rack area to terminal server in nearby rack area.
- Will eventually need direct fiber link to ROC if max bandwidth > 80 MB/s, assuming 10**8 photons/sec.
Finally
- No multi-mode fibers are included below, let us know if you need them run anywhere.
Rack | DAQ Connections | Controls Connections | TS Connections | Max Single ROC Bandwidth | Total Uplink Bandwidth | Fiber Bundle | Switches | Terminal Servers | Possible ROC Fiber Uplinks | Comment |
---|---|---|---|---|---|---|---|---|---|---|
T1 | 6 | 12 | 6 | <80 MB/s | 151 MB/s | 12 strand | 1 | 1 | 0 | |
U1A | 0 | 7 | 1 | 0 | low | none | 1 | 0 | 0 | Fiber patch to U1B, TS patch to U1B |
U1B | 5 | 8 | 5 | <50 MB/s | 93 MB/s | 12 strand | 1 | 1 | 0 | Fiber uplinks from U1A, U1C, UN1 |
U1C | 2 | 3 | 2 | low | low | none | 1 | 0 | 0 | Fiber patch to U1B, TS patch to U1B |
U1D | 0 | 1 | 0 | 0 | 0 | none | 0 | 0 | 0 | Copper Ethernet patch to U1C |
N1 | 8 | 13 | 8 | < 80 MB/s | 450 MB/s | 12 strand | 1 | 1 | 0 | |
S1 | 8 | 13 | 8 | < 80 MB/s | 450 MB/s | 12 strand | 1 | 1 | 0 | |
US1 | 0 | 0 | 0 | 0 | 0 | none | 0 | 0 | 0 | Not sure what's going on here |
U2A | 9 | 12 | 9 | 100 MB/s | 770 MB/s | 12 strand | 1 | 1 | 5 | 2 fiber patches to D2A if needed |
U2B | 9 | 12 | 9 | 136 MB/s | 916 MB/s | 12 strand | 1 | 1 | 5 | 2 fiber patches to D2B if needed |
D2A | 9 | 19 | 10 | < 80 MB/s | 370 MB/s | 12 strand | 2 | 1 | 0 | includes 2 gas shed connections |
D2B | 6 | 7 | 6 | < 80 Mb/s | 300 MB/s | 12 strand | 1 | 1 | 0 | |
UN1 | 0 | 20 | 0 | 0 | low | none | 1 | 0 | 0 | Fiber patch to U1B |
Summary
- Install 8 x 12 = 96 fiber strands, not including any multi-mode fibers needed.
- Install 12 switches total.
- Install 8 terminal servers.
- 10 ROC's may need fiber uplink at 10**8 photons/sec, none needed at 5 10**7 photons/sec.
- Inexpensive fiber patch cables used to minimize number of fiber bundles needed.
- Inexpensive RS232 patch cables used to minimize number of terminal servers needed.
- Important: these recommendations do not follow Fernando's note exactly!