Difference between revisions of "Hall Network Specifications"
From GlueXWiki
m |
m |
||
Line 36: | Line 36: | ||
|T1 || 6 || 12 || 6 || <80 MB/s || 151 MB/s || 12 strand || 1 || 1 || 0 || | |T1 || 6 || 12 || 6 || <80 MB/s || 151 MB/s || 12 strand || 1 || 1 || 0 || | ||
|- | |- | ||
− | |U1A || 0 || 7 || 1 || 0 || low || none || 1 || 0 || 0 || Fiber patch to U1B, TS patch to U1B | + | |U1A || 0 || 7 || 1 || 0 || low || none || 1 || 0 || 0 || Fiber patch switch to U1B, TS port patch to U1B |
|- | |- | ||
|U1B || 5 || 8 || 5 || <50 MB/s || 93 MB/s || 12 strand || 1 || 1 || 0 || Fiber uplinks from U1A, U1C, UN1 | |U1B || 5 || 8 || 5 || <50 MB/s || 93 MB/s || 12 strand || 1 || 1 || 0 || Fiber uplinks from U1A, U1C, UN1 | ||
|- | |- | ||
− | |U1C || 2 || 2 || 2 || low || low || none || 1 || 0 || 0 || Fiber patch to U1B, TS patch to U1B | + | |U1C || 2 || 2 || 2 || low || low || none || 1 || 0 || 0 || Fiber patch switch to U1B, TS port patch to U1B |
|- | |- | ||
− | |U1D || 0 || 1 || 0 || 0 || 0 || none || 0 || 0 || 0 || Copper Ethernet patch to U1C | + | |U1D || 0 || 1 || 0 || 0 || 0 || none || 0 || 0 || 0 || Copper Ethernet patch to switch in U1C |
|- | |- | ||
|N1 || 8 || 13 || 8 || < 80 MB/s || 450 MB/s || 12 strand || 1 || 1 || 0 || | |N1 || 8 || 13 || 8 || < 80 MB/s || 450 MB/s || 12 strand || 1 || 1 || 0 || | ||
Line 50: | Line 50: | ||
|US1 || 0 || 0 || 0 || 0 || 0 || none || 0 || 0 || 0 || Not sure what's going on here | |US1 || 0 || 0 || 0 || 0 || 0 || none || 0 || 0 || 0 || Not sure what's going on here | ||
|- | |- | ||
− | |U2A || 9 || 12 || 9 || 100 MB/s || 770 MB/s || 12 strand || 1 || 1 || 5 || 2 fiber patches to D2A if needed at 10**8 | + | |U2A || 9 || 12 || 9 || 100 MB/s || 770 MB/s || 12 strand || 1 || 1 || 5 || 2 ROC fiber patches to D2A if needed at 10**8 |
|- | |- | ||
− | |U2B || 9 || 12 || 9 || 136 MB/s || 916 MB/s || 12 strand || 1 || 1 || 5 || 2 fiber patches to D2B if needed at 10**8 | + | |U2B || 9 || 12 || 9 || 136 MB/s || 916 MB/s || 12 strand || 1 || 1 || 5 || 2 ROC fiber patches to D2B if needed at 10**8 |
|- | |- | ||
− | |D2A || 9 || 19 || 10 || < 80 MB/s || 370 MB/s || 12 strand || 2 || 1 || 0 || includes 2 gas shed connections | + | |D2A || 9 || 19 || 10 || < 80 MB/s || 370 MB/s || 12 strand || 2 || 1 || 0 || includes 2 gas shed controls connections |
|- | |- | ||
|D2B || 6 || 8 || 6 || < 80 Mb/s || 300 MB/s || 12 strand || 1 || 1 || 0 || | |D2B || 6 || 8 || 6 || < 80 Mb/s || 300 MB/s || 12 strand || 1 || 1 || 0 || | ||
|- | |- | ||
− | |UN1 || 0 || 20 || 0 || 0 || low || none || 1 || 0 || 0 || Fiber patch to U1B | + | |UN1 || 0 || 20 || 0 || 0 || low || none || 1 || 0 || 0 || Fiber patch switch to U1B |
|} | |} | ||
Revision as of 17:18, 14 October 2013
Below we propose a design for fiber connections between the Rack Room and the Hall, and network switch and terminal server placement.
- Elliott Wolin, Mark Dalton
- 14-Oct-2013
Notes
- Based on 10**8 photons/sec, 200 kHz trigger rate, existing L1 rejection algorithm, block=1 mode, no compression.
- Ethernet port counts from Fernando's rack layouts and information from Dave Butler concerning other controls requirements.
- We own about 15 24-port managed switches with 10 GBit/s fiber uplinks, some being used in EEL building and other places.
- Switches can uplink 1.25 GBytes/sec.
- 8-port managed switches with 1 GBit/s fiber uplinks exist.
- Only managed switches (no hubs!) allowed in hall.
- Fibers come in bundles of 12 or 24, 2 fibers needed for one uplink.
- Standard JLab practice is to terminate all fibers in patch panel when bundles installed.
- Bundle/patch panel installation is expensive, can run much cheaper patch fibers from switch/ROC in one rack area to patch panel in nearby rack area.
- DAQ crates require two Ethernet connections each, one for the ROC and one for the fan tray.
- Some ROC's are only used for control, not DAQ (e.g. BCAL LED Pulser).
- ROC's each need an RS232 connection to a terminal server, terminal servers require an Ethernet connection.
- Each terminal server has 32 ports.
- Can run copper RS232 patch cable from one rack area to terminal server in nearby rack area.
- Will eventually need direct fiber link to ROC if max bandwidth > 80 MB/s, assuming 10**8 photons/sec.
Important Notes
- No multi-mode fibers are included below, let us know if you need them run anywhere.
- We have no information about US1!
Rack | DAQ Connections | Controls Connections | TS Connections | Max Single ROC Bandwidth | Total Uplink Bandwidth | Fiber Bundle | Switches | Terminal Servers | Possible ROC Fiber Uplinks | Comment |
---|---|---|---|---|---|---|---|---|---|---|
T1 | 6 | 12 | 6 | <80 MB/s | 151 MB/s | 12 strand | 1 | 1 | 0 | |
U1A | 0 | 7 | 1 | 0 | low | none | 1 | 0 | 0 | Fiber patch switch to U1B, TS port patch to U1B |
U1B | 5 | 8 | 5 | <50 MB/s | 93 MB/s | 12 strand | 1 | 1 | 0 | Fiber uplinks from U1A, U1C, UN1 |
U1C | 2 | 2 | 2 | low | low | none | 1 | 0 | 0 | Fiber patch switch to U1B, TS port patch to U1B |
U1D | 0 | 1 | 0 | 0 | 0 | none | 0 | 0 | 0 | Copper Ethernet patch to switch in U1C |
N1 | 8 | 13 | 8 | < 80 MB/s | 450 MB/s | 12 strand | 1 | 1 | 0 | |
S1 | 8 | 13 | 8 | < 80 MB/s | 450 MB/s | 12 strand | 1 | 1 | 0 | |
US1 | 0 | 0 | 0 | 0 | 0 | none | 0 | 0 | 0 | Not sure what's going on here |
U2A | 9 | 12 | 9 | 100 MB/s | 770 MB/s | 12 strand | 1 | 1 | 5 | 2 ROC fiber patches to D2A if needed at 10**8 |
U2B | 9 | 12 | 9 | 136 MB/s | 916 MB/s | 12 strand | 1 | 1 | 5 | 2 ROC fiber patches to D2B if needed at 10**8 |
D2A | 9 | 19 | 10 | < 80 MB/s | 370 MB/s | 12 strand | 2 | 1 | 0 | includes 2 gas shed controls connections |
D2B | 6 | 8 | 6 | < 80 Mb/s | 300 MB/s | 12 strand | 1 | 1 | 0 | |
UN1 | 0 | 20 | 0 | 0 | low | none | 1 | 0 | 0 | Fiber patch switch to U1B |
Summary
- Need 8 x 12 = 96 fiber strands, not including any multi-mode fibers needed.
- Need 12 switches total.
- Need 8 terminal servers.
- 10 ROC's may need fiber uplink at 10**8 photons/sec, none needed at 5 10**7 photons/sec.
- Inexpensive fiber patch cables used to minimize number of fiber bundles needed.
- Inexpensive RS232 patch cables used to minimize number of terminal servers needed.
- Important: these recommendations do not follow Fernando's note exactly:
- Removed fiber patch panel and TS from U1A
- Removed TS from U1C
- Removed fiber patch panel and switch from US1
- Removed switch from U2A
- Added TS to U2B
- Added TS to D2B