Like all big data applications, Gateway Hub has significant hardware requirements. Refer to the table below for our recommended hardware specifications and consult the Hardware guidelines for guidelines for components.
To get some guidance on how many nodes to include in your cluster based on the size of your Geneos estate, see Plan the cluster.
The following hardware specification is recommended for each Gateway Hub node in production:
|Component||Recommended Setup||Minimum Requirements|
|Server||2U Rack Server/Chassis.|
|System board||Dual CPU socket system board.|
|CPU||2 x 8-core 64-bit CPU, 32 cores with hyper-threading enabled.||8 cores|
8 x 8GB DIMMs, 64GB RAM (DIMM count must be multiple of CPU memory channels).
|Network||10GbE network interface.|
Note: The above server specification corresponds to the EC2 (Amazon Web Services) instance
m5.2xlarge, which is suitable for deploying Gateway Hub in the cloud.
The diagram below provides information on the disk setup required for Gateway Hub:
We recommend the following
|Disk number and size||Formatted/Unformatted||Purpose|
|1 x disk||Formatted||OS|
|1 x disk||Formatted||Zookeeper transaction logs|
|1 x 2TB disk||Formatted||Kafka|
|12 x SATA 2TB disks||Unformatted with no partitions||MapR|
- Use CPUs with as many cores as possible, and prioritise additional cores over a slightly higher clock speed.
For optimal performance, each of the following should be assigned a separate disk or disks:
- Operating system
- Postgresql data and write ahead log
In addition, when installing Gateway Hub consider:
- MapR requires unformatted disks with no partitioning.
- The MapR disks must be entirely SSDs or entirely HDDs on one node. Mixing disks on the same node for MapR is not supported.
- An SSD, with at least 1GB space, is recommended for Zookeeper.
For larger Geneos estates we also recommend a separate disk is provided for the location for the Spark intermediate files.
- SAS drives can provide better I/O latency. SSDs provide even lower latency.
- Match aggregate drive throughput to network throughput. 10GbE ~= 10-12 drives.
- Raw disks should be used instead of Logical Volume Manager (LVM).
The number and performance of disks required for different Gateway Hub components will ultimately depend on the specific details of your deployment.