CSCF Infrastructure Technology Group


CSI  » Services  » Network

See also IST's TIS Network Services resource : “Assigned Internet names and numbers

Vlan Information

Design Principles CSCF Recommends

When working with IST on DRCSCS networking (OSPF Area 4) enhancments (many of which are funded via SCS research grants), the following principles (in order of priority) are followed:

  1. Very high availability.

    CSCF continues to expand the use of redundancy which also includes redundant edge device connections for our essential servers. Having a switch failure (or reboot for firmware upgrade) should not affect anything except the edge devices that only use a single switch network connectivity setup. We had extensive network equipment problems from 2000-2005 that makes this a very sensitive area.

  2. Equipment Spares

    IST maintains a set of spares (of their recommended switch models) for all single point of failure networking devices it deploys.

  3. Electrical Power

    CSCF capacity-planning does not cover networking equipment (which is managed by IST). [an error occurred while processing this directive]

  4. Security (Needs to be reviewed with decommissioning of School based firewalls.)

    Zoned Security Setup.
    We use Subnet boundaries to protect groupings of equipment from each other, the rest of campus and the world. The Zones also protect the world, rest of campus and other equipment groupings from a specific zone.
  5. Remote Management.

    Our remote access to the switches is via ISTs Open Network Administrator: ona.

  6. Bandwidth.

    We use LACP to provide aggregated bandwidth (which has the side benefit of limiting the maximum bandwidth of a single source/destination pair from saturating our network).

  7. Performance.

    Design to be able to support the maximum IEEE 802.3 standardized connection speeds between server-room to server-room edge ports independent of campus location. Keep in mind the CSCF Infrastructures Principle Guideline:

    Proactively providing flexible technical services to meet specialized demands mandated by the School of Computer Science

Network Resource Categories

Out-of-Band (OOB)

Building Aggregation Room (BAR)

  1. All fibre runs (internal and external) are to "star" or "home-run" from a single point within the building. This may be a telecommunication room, or a server room, or any restricted-to-IT-staff area of the building.
  2. Each Building is to have high performance redundant hardware aggregation switch(es) at the hub of the fibre "star".
  3. Preferably access to this area is controlled via electronic fob.
  4. It should have at least a pair of 208 volt, 30 amp electrical circuits for redundant heavy duty Uninterruptible Power Supplies (UPS) so a minimum power outage runtime of 30 minutes will be supplied to all equipment used to provide, manage and monitor the network.

Server Rooms (SRs)

  1. Server room networking is setup with high capacity networking devices (like what's used for Building Aggregation) in a similar configuration as Telecommunication Rooms.
  2. They are to always have at least 6 strands (3 pairs) of single-mode fibre back to the BAR; one pair to each "side" of the redundant building aggregation switch setup and one extra pair for emergency use. Preferably these strands would not all be in the same jacket, however that's not the current practice.
  3. A least three copper serial lines are run back to the BAR for switch console connections.
  4. Patch panel cabling between Communications Rack and each Server Racks facilitate the easy racking of new devices.
  5. Appropriate networking bandwidth allocation for devices is listed below.
  6. It should have the same UPS power setup as BARs.

Telecommunication Rooms (TRs)

  1. They are to always have at least 6 strands (3 pairs) of single-mode fibre back to the BAR; one pair to each "side" of the redundant building aggregation switch setup and one extra pair for emergency use. Preferably these strands would not all be in the same jacket, however that's not the current practice.
  2. A least three copper serial lines are run back to the BAR for switch console connections.
  3. The first two switches deployed into a TR are to be high performance aggregation switches.
  4. Preferably access to this area is controlled via electronic fob.
  5. It should have at least a pair of 120 volt, 20 amp electrical circuits for redundant medium duty Uninterruptible Power Supplies (UPS) that can supply 30 minutes of runtime during a power failure.

Telecommunication Cabinets (TCs)

  1. TCs are used in teaching labs where the copper cables are run from each work area back to wall mount cabinets inside the room.
  2. TCs are to always have at least 6 strands (3 pairs) of single-mode fibre connecting the TC with the server room hosting the computing services for that teaching lab. Preferably these strands would not all be in the same jacket, however that's not the current practice.
  3. A least a pair of copper serial lines are run to the nearest TR for switch console connections.
  4. Cabinets are to be locked with a common keyed padlock.
  5. Each cabinet should have its own 120 volt, 15 amp electrical circuit.

Edge Ports

  1. Network Wall Boxes:
    During renovation or new construction, install wall network boxes beside each electrical outlet. Wall network ports should be the same level of commodity item as wall electrical ports. The major expense is the installation of wall outlet box and conduit that connects it to the hallway network cable run. Delaying the installation of these boxes and conduit severely affect esthetics and increases cost when they are needed.
  2. Network Wall Jacks (installed in above boxes):
    Two network outlets per work-site (Workstation and Laptop support) plus one network outlet per room for a phone line.
  3. Network Connection Types (effective for new connections as of July 2010):
    • 10/100 Mb ports are provided for printers, remote management devices, and older equipment that doesn't support 1 Gb connections.
    • 1 Gb Power-Over-Ethernet is provided for specialty devices (like VOIP phones). These connections are provided by the TR aggregation devices.
    • 10 Gb ports are provided for server hardware where there is an expectation of running more that 5 virtual machines on it or high volumes of NAS traffic is expected. This includes blade chassis.
    • 1 Gb is provided to all other network ports.

Firewalls

  1. IST removed School of Computer Science zone based firewall devices in favour of router based ACL's during the Summer of 2013.

Uninterruptible Power Supplies (UPS)

    [an error occurred while processing this directive]

Cabling

Any new construction that has any networking less than minimum standards gets all it's networking upgraded to current standard.

Cat 6a, FT4, Copper
Used from TCs and TRs to the wall jack.
Multi-mode Fibre
Historically used to provide 1 Gb connections between BARs, SRs, TRs and TCs within a building. No longer used for new deployments as it doesn't readily support the higher speeds over the standard distances.
Single-mode Fibre
As of spring 2020, 100 Gb network deployment is our standard interconnection medium for connections between BARs, SRs, TRs, TCs and some researcher offices. Always deploy at least one extra pair when pulling new cable.

Layout Maps

Overview
Campus Backbone Weathermap from CS Area Border Connections to Internet Service.
School of Computer Science backbone
Server Rooms Networking
Server Rooms Networking 2022 Proposal

Resource Usage Graphs

CS Uplink Interfaces.

Old History

Information on how CS networking ended up in under IST management.