Data Centers

Physical facility used by enterprises to house computing and storage. Provides…

Datacenter Architecture

High cost powerful CPUs, with more core and more memory

Add more lower cost servers

Servers with CPU, DRAM and Disks are placed in Racks (typically 40-80 servers). Racks are placed in rows and connected to a cluster switch.

Power Usage Effectiveness is the ratio of total energy used at DC vs that which is delivered to computing equipment

All IT Systems (servers, networking etc.) + Other Equipment (cooling, UPS, generators, lights, fans)

1.15-1.18

How to Cool?
Energy Proportional Computing
- The measure of the relationship between power consumed in a computer system, and the rate at which useful work is done [Wikipedia]
Idle Servers
- Virtualize servers into resource pools
- Allow other virtualized services access to resources if needed
Efficient Monitoring
- Better understand what is going on
Managing Scale and Growth
- How to scale data center operations
Networking at Scale
- How to abstract networks to work at these sizes

Hyper Scale System Management Software
- Treat datacenter as a huge computer
- Software defined “datacenters”
- Compose a software defined system of pooled resources to assign resources based off of workload requirements
Dynamic Resource Allocation
- Virtualization is not enough to improve efficiency
- Ability to dynamically allocate CPU resources --> Shift demand

Traditional Rack Architecture
- Server which has all components
  - GPU server: CPU, RAM, GPU
  - General server: CPU, RAM
  - SCUTI-O Server: CPU, RAM , SCUTI-O
Disaggregated Rack Architecture
- Racks with all CPU, rack with DRAM, etc.
- Software selects what is needed and creates virtualized systems

Inverse of data center efficiency