Performance Guidelines for Developing a Storm Topology
The following table lists several general performance-related guidelines for developing Storm topologies.
Table 4.4. Storm Topology Development Guidelines
Guideline |
Description |
---|---|
Read topology configuration parameters from a file. |
Rather than hard coding configuration information in your Storm
application, read the configuration parameters, including
parallelism hints for specific components, from a file inside the
|
Use a cache. |
Use a cache to improve performance by eliminating unnecessary operations over the network, such as making frequent external service or lookup calls for reference data needed for processing. |
Tighten code in the |
Every tuple is processed by the |
Perform benchmark testing to determine latencies. |
Perform benchmark testing of the critical points in the network flow of your topology. Knowing the capacity of your data "pipes" provides a reliable standard for judging the performance of your topology and its individual components. |