configuring of test environment required some work,
- Validation of load tests execution for hardware components for switches and network cards: correct full duplex mode operation, correct emulation of user latency and bandwidth
- Validation of load tests execution for test data feeds in application and test consumption: number of products, user ids, and orders shipped, etc.
- Validation of load tests execution for cluster load balancing: IP switching, percentage of distribution, priority settings.
- Validation of load tests execution for SQL deployment: data and log files distribution, network cards in web servers etc.
Note: With a conceptual strategy, get the tools and resources prepared to execute the strategy as features and components become available for test.
Load generation and application monitoring tools are almost never as easy to get up and running as one expects. Whether issues arise from setting up isolated network environments, procuring hardware, coordinating a dedicated bank of IP addresses for IP spoofing, or version compatibility between monitoring software and server operating systems, issues always seem to arise.
Also, it is inevitable that load generation tools are always behind evolving technologies and practices. Tool creators can only build in support for the most prominent technologies, and even then, they have to become prominent before the support can be built.
This often means that some of the biggest challenges a performance testing project faces may include: getting your first three-user, two-scenario, three-loop prototype test running with no script errors; parameterized variables; authentication and sessions handled correctly; data collected correctly; and users generally being simulated in such a way that the application under test cannot legitimately tell the difference between real users and simulated users. Plan for this and do not be surprised when it takes significantly longer than expected to get it all working smoothly.
Additionally, plan to periodically reconfigure, update, add or otherwise enhance your load generation environment and associated tools throughout the project. Even if the application under test stays the same and the load generation tool is working properly, it is likely that the metrics you wish to collect will change. This frequently implies some degree of change to or addition of monitoring tools.
Related Topics:


0 comments:
Post a Comment