Hardware requirements

Recommended hardware setup

Like all big data applications, Gateway Hub has significant hardware requirements. Refer to the table below for our recommended hardware specifications and consult the Hardware guidelines for guidelines for components.

To get some guidance on how many nodesA node is one server that consistutes a Gateway Hub instance. Many nodes form a cluster. to include in your clusterThe set of nodes that form a Gateway Hub instance. based on the size of your Geneos estate, see Plan the cluster.

The following hardware specification is recommended for each Gateway Hub node in production:

Component Recommended Setup Minimum Requirements
Server 2U Rack Server/Chassis.  
System board Dual CPU socket system board.  
CPU 2 x 8-core 64-bit CPU, 32 cores with hyper-threading enabled. 8 cores
Memory

8 x 8GB DIMMs, 64GB RAM (DIMM count must be multiple of CPU memory channels).

32GB RAM
Disks See Disks.  
Network 10GbE network interface.  

Note: The above server specification corresponds to the EC2 (Amazon Web Services) instance m5.2xlarge, which is suitable for deploying Gateway Hub in the cloud.

Disks

The diagram below provides information on the disk setup required for Gateway Hub:

We recommend the following 15 disk arrangement for a production Gateway Hub node:

Disk number and size Formatted/Unformatted Purpose
1 x disk Formatted OS
1 x disk Formatted Zookeeper transaction logs
1 x 2TB disk Formatted Kafka
12 x SATA 2TB disks Unformatted with no partitions MapR

Hardware guidelines

CPUs

  • Use CPUs with as many cores as possible, and prioritise additional cores over a slightly higher clock speed.

Disks

  • The MapR disks must be entirely SSDs or entirely HDDs on one node. Mixing disks on the same node for MapR is not supported.
  • Fewer and/or smaller disks can be used for MapR. The number of disks is dependent on your organisation's storage requirements.
  • An SSD is recommended for the disk for the Zookeeper transaction logs.
  • For larger Geneos estates we also recommend a separate disk is provided for the location for the Spark intermediate files.
  • SAS drives can provide better I/O latency. SSDs provide even lower latency.
  • Match aggregate drive throughput to network throughput. 10GbE ~= 10-12 drives.
  • Raw disks should be used instead of Logical Volume Manager (LVM).

Memory

  • Gateway Hub benefits greatly from lots of RAM. 256GB per node or more.