Difference between revisions of "Talk:CITCONANZ2013Sessions/PerformanceTestingInAgile"

From CitconWiki
Jump to navigationJump to search
(Created page with "Performance Testing in an Agile Environment ---- Challenges for Performance Testing in a CI/CD environment: *Getting people educated about performance pain points *Infrastr...")
 
 
Line 12: Line 12:
  
  
Agile Performance Testing requirments for incrememtal releases
+
Agile Performance Testing requirements for incremental releases
 
*What are the requirements?
 
*What are the requirements?
 
*What has been changed?
 
*What has been changed?
 
*Use the above to define realistic and reasonable tests
 
*Use the above to define realistic and reasonable tests
 
*Warm and fuzzy by doing incremental/incomplete Performance Tests
 
*Warm and fuzzy by doing incremental/incomplete Performance Tests
*Do Breakpoint testing
+
*Do Break point testing
 
----
 
----
  
Line 29: Line 29:
  
  
Tools for affordable performance risk mitigaion
+
Tools for affordable performance risk mitigation
 
*JMeter cuts cost allowing for cheap and incomplete tests  
 
*JMeter cuts cost allowing for cheap and incomplete tests  
 
*Blazemeter is a JMeter compatible cloud performance testing service
 
*Blazemeter is a JMeter compatible cloud performance testing service
Line 43: Line 43:
  
 
Manage risks of making changes.
 
Manage risks of making changes.
*Take responsibilite of changes made for all aspects of code development
+
*Take responsibility of changes made for all aspects of code development
*Make certina tests are run on a production like environment
+
*Make certain tests are run on a production like environment
 
*Separate code and configuration testing.
 
*Separate code and configuration testing.
 
----
 
----
Line 50: Line 50:
  
  
Pre Public Launch testing - Before
+
Public Launch testing - Before the big go-live
 
*Decouple PT into a separate project for major releases
 
*Decouple PT into a separate project for major releases
 
*Final builds must involve end to end performance testing
 
*Final builds must involve end to end performance testing
 
*Run all performance tests: Baseline, Peak, Endurance and Capacity
 
*Run all performance tests: Baseline, Peak, Endurance and Capacity
*Push complete performance test projects into pre public production release
+
*Push complete performance test projects into public production release

Latest revision as of 22:08, 10 February 2013

Performance Testing in an Agile Environment



Challenges for Performance Testing in a CI/CD environment:

  • Getting people educated about performance pain points
  • Infrastructure is not ready for performance testing
  • Scheduling clashes with Operational groups
  • Look into an environment


Agile Performance Testing requirements for incremental releases

  • What are the requirements?
  • What has been changed?
  • Use the above to define realistic and reasonable tests
  • Warm and fuzzy by doing incremental/incomplete Performance Tests
  • Do Break point testing


Code Instrumentation

  • Label instrument all code during development
  • Labelled code allows for Green fields data collection
  • Labelled code helps pinpoint code issues.
  • Done using a different labelled build


Tools for affordable performance risk mitigation

  • JMeter cuts cost allowing for cheap and incomplete tests
  • Blazemeter is a JMeter compatible cloud performance testing service


Load Particular features to determine whether new code harbors performance issues.

  • Beware of false positives during incremental performance tests.
  • Isolate performance tests to newly developed features.


Manage risks of making changes.

  • Take responsibility of changes made for all aspects of code development
  • Make certain tests are run on a production like environment
  • Separate code and configuration testing.


Public Launch testing - Before the big go-live

  • Decouple PT into a separate project for major releases
  • Final builds must involve end to end performance testing
  • Run all performance tests: Baseline, Peak, Endurance and Capacity
  • Push complete performance test projects into public production release