Because Testspace is a new type of application that does not fit into a classic product category we often get asked
what is Testspace?
First a little history
Our original plan did not include a standalone version of Testspace. It evolved over the years, first internally, and then with a key customer who had a need for managing complex results from different product lines.
Our first product Stride is a test framework for C/C++, specifically for embedded devices. This test framework allowed developers to write and execute tests on actual hardware -- without changing the build. Over time these tightly constrained embedded devices have become more like desktop computers allowing for many more tools, frameworks, etc., to generate test cases.
Faced with these changing trends in embedded computing we set out to make our test framework better by integrating it with a web-application. The concept was to use the web application to create a test design, run the design, and overlay the test results for viewing as well as adding in team collaboration features. Everything related to the tests would be fully integrated and unified in the web-application. The early versions of this were very much coupled to our Stride test framework. Gradually, over time we started publishing results from other test frameworks. It then became apparent to us that most managers and leads were not focused on the specifics of a particular test framework, but rather wanted to see overall results, metrics, and trends. This changed our view and we increased our focus on supporting test content for any language, framework, or tool.
Testspace is a platform for collecting metrics-focused test content used to help manage the software development process.
Testspace goes beyond simply collecting and formatting data metrics by performing in-depth analysis and generating quality insights – analytics that facilitate the monitoring and driving of the development workflow.
How does using metrics help manage the software development process?
- The metrics important to you are what you measure and what you manage. These metrics set the standards to which your developers perform.
- Managing complex projects can be difficult. Relying only on gut feelings and hunches from team members can be risky. Letting clear and measured data speak for itself helps everyone.
- Metrics (and analytics) help determine what areas should be focused on. Having data-focused insights on how the development is really proceeding are critical to making good decisions.
Testspace in the workflow
Today’s development teams typically use CI (continuous integration), whereby software commits trigger the processes where software is automatically pulled from the repository, products are built from scratch, and all associated tests are executed. As software grows in complexity, the value of these test assets correspondingly increases in value.
Once tests are executed, results are automatically pushed to Testspace. Other types of metrics such as code coverage, static analysis, etc. can also be automatically published as they are created. These additional metrics also provide important indicators of the current health of the code base
Testspace facilitates the collective publishing of all types of metrics, even including custom-crafted metrics based on your project's specific needs!
Your software health can be better managed with this aggregated data. Testspace presents all of the test content together for visual inspection, tracks trending information such as regression rates, resolution thresholds, stability, etc. Users can be automatically alerted when the software health regresses. Built-in analytics provide unique insights regarding the usefulness of the tests, the team's quality efficiency, and much more. Insights and metrics can be viewed in various ways – from the in-depth perspective of a front-line developer to concise yet detailed presentations for fast-paced managers.
Testspace fits well with today's widespread adoption of Continuous Integration. Teams now can generate quality insights as part of their normal development workflow and leverage these data insights to manage and improve the software development process.
Check out our team's live development data using Testspace.