Hardware requirements

Recommended hardware setup

Like all big data applications, Gateway Hub has significant hardware requirements. Refer to the table below for our recommended hardware specifications and consult the Hardware guidelines for guidelines for components.

To get some guidance on how many nodes to include in your cluster based on the size of your Geneos estate, see Plan the cluster.

The following hardware specification is recommended for each Gateway Hub node in production:

Component Recommended Setup Minimum Requirements
Server 2U Rack Server/Chassis.  
System board Dual CPU socket system board.  
CPU 2 x 8-core 64-bit CPU, 32 cores with hyper-threading enabled. 8 cores
Memory

8 x 8GB DIMMs, 64GB RAM (DIMM count must be multiple of CPU memory channels).

32GB RAM
Disks See Disks.  
Network 10GbE network interface.  

Note: The above server specification corresponds to the EC2 (Amazon Web Services) instance m5.2xlarge, which is suitable for deploying Gateway Hub in the cloud.

Disks

The diagram below provides information on the disk setup required for Gateway Hub:

We recommend the following 15 disk arrangement for a production Gateway Hub node:

Disk number and size Formatted/Unformatted Purpose
1 x disk Formatted OS
1 x disk Formatted Zookeeper transaction logs
1 x 2TB disk Formatted Kafka
12 x SATA 2TB disks Unformatted with no partitions MapR

Hardware guidelines

CPUs

  • Use CPUs with as many cores as possible, and prioritise additional cores over a slightly higher clock speed.

Disks

For optimal performance, each of the following should be assigned a separate disk or disks:

  • Operating system
  • Zookeeper
  • Kafka
  • Postgresql data and write ahead log
  • MapR

In addition, when installing Gateway Hub consider:

  • MapR requires unformatted disks with no partitioning.
  • The MapR disks must be entirely SSDs or entirely HDDs on one node. Mixing disks on the same node for MapR is not supported.
  • An SSD, with at least 1GB space, is recommended for Zookeeper.
  • For larger Geneos estates we also recommend a separate disk is provided for the location for the Spark intermediate files.
  • SAS drives can provide better I/O latency. SSDs provide even lower latency.
  • Match aggregate drive throughput to network throughput. 10GbE ~= 10-12 drives.
  • Raw disks should be used instead of Logical Volume Manager (LVM).

The number and performance of disks required for different Gateway Hub components will ultimately depend on the specific details of your deployment.

Memory

  • Gateway Hub benefits greatly from lots of RAM. 256GB per node or more.