Guest: Dan Faulkner (LinkedIn)
Company: SmartBear (Twitter)
Show: Let’s Talk

SmartBear aims to revolutionize software quality by incorporating AI technologies into its product offerings, which include tools for API lifecycle management, application testing, and performance monitoring.

“The purpose of SmartBear as a company is to revolutionize software quality,” says Dan Faulkner, Chief Product and Technology Officer at SmartBear. “Our mission is all about improving and enhancing software quality. We think that’s a persistent, global, horizontal challenge, and that’s what we’re all about.”

Faulkner discusses the shift toward generative AI (GenAI) to boost non-developer testers’ productivity, reduce developer workload, and enhance testing capabilities in areas like visual regression, mobile applications, and API contract testing. Faulkner also outlines SmartBear’s roadmap for integrating AI into future testing and documentation processes. Faulkner says, “We think there’s a whole new realm of productivity that GenAI opens up in the testing space.”

Introduction to SmartBear and its mission to enhance software quality

• Faulkner talks about the role of AI technologies in revolutionizing software development and testing methodologies. SmartBear aims to change the landscape of software quality through innovative solutions and practices that drive efficiency and reliability.
• SmartBear’s overarching goal is to significantly enhance software quality on a global scale, addressing a pervasive challenge that affects developers, organizations, and users alike across multiple sectors and industries.

SmartBear’s diverse product portfolio and functional hubs

• Faulkner describes SmartBear’s portfolio of products, which can be organized into three main categories: API lifecycle management, application testing, and a dedicated insight hub designed for performance analysis and optimization.
• The API lifecycle management platform oversees all stages of API development, including design, documentation, and rigorous testing phases—exploratory, contract, performance, and functional testing—to ensure reliability and robustness.
• The application testing hub empowers low-code and no-code testers by offering comprehensive end-to-end testing solutions, including functional testing, cross-browser compatibility checks, real device testing, load testing, and visual regression testing.
• Faulkner tells us that the insight hub focuses on optimizing application performance through full-stack performance monitoring, crash analytics, error reporting, and proactive measures that enhance user experiences and identify potential issues early.

How are modern app development trends affecting SmartBear’s strategy?

• Faulkner discusses the rapid evolution of modern app development, acknowledging the growing responsibilities placed on developers due to the shift-left approach, where developers are now expected to oversee the entire lifecycle of their code.
• SmartBear aims to alleviate this increased burden on developers by harnessing advanced technologies, particularly generative AI, to boost the productivity and effectiveness of testers who may not have extensive technical backgrounds.
• The company focuses on supporting customers at their current stage of development, providing tailored solutions and tools that avoid overwhelming developers with additional tasks or complexities, thereby enhancing overall project success.

The evolving role of AI in software development

• Faulkner delves into the changing role of AI in software development, noting that while AI has been a part of the industry for many years, its recent prominence has surged with the growing capabilities of generative AI applications.
• Faulkner highlights the dual nature of AI’s impact on code quality, explaining how it can significantly accelerate code creation and efficiency while simultaneously introducing potential bugs and increasing technical debt.
• SmartBear believes AI excels in testing tasks due to their clear pass/fail outcomes, unlike coding tasks that require nuanced context, stylistic considerations, and a deeper understanding of software architecture for optimal implementation.
• The company is dedicated to utilizing AI and generative AI to transform software quality, all while ensuring that developers are not burdened with additional responsibilities or complicated new tools, thereby streamlining workflows and improving productivity.

What is SmartBear’s approach to generative AI integration?

• Faulkner discusses SmartBear’s strategy for integrating generative AI into their offerings, a framework known as Halo AI, which builds upon established foundational models to deliver enhanced functionality and user experience.
• The company has standardized the use of OpenAI models and developed a comprehensive knowledge graph that serves as a crucial interface between the product interface and the large language model (LLM), facilitating intelligent data processing and insights.
• Halo AI introduces innovative automation capabilities and generative AI-driven features in existing products, allowing customers to selectively choose whether to utilize these advanced AI capabilities based on their specific needs and operational requirements.
• SmartBear’s primary goal is to enhance their existing product offerings, rather than developing standalone generative AI solutions, thus maintaining flexibility to address diverse industry requirements and client preferences.

What are SmartBear’s generative AI use cases?

• Faulkner shares some examples of SmartBear’s innovative application of generative AI within their products, beginning with the introduction of natural language test specifications designed to make testing more accessible to a broader range of users.
• SmartBear now enables users to write test automation scripts in straightforward English, simplifying the process for non-technical testers and allowing them to create automated tests with greater confidence, significantly reducing the technical barriers to automation.
• Faulkner talks about how they are using Visual AI technology to analyze the behavior of mobile native applications, facilitating functional testing that ensures high-quality user experiences through visual verification techniques.
• Generative AI is also utilized in API contract testing, where it generates contract tests based on user-defined endpoints thus streamlining the testing process and enhancing efficiency.

SmartBear’s future roadmap and key focuses

• Faulkner shares SmartBear’s roadmap for generative AI, detailing their use cases that span across all their hubs, designed to elevate functionality and improve user experiences in software quality assurance.
• In the API lifecycle management area, the company also plans to enhance testing environments and explore language-driven extensions that include comprehensive documentation and intuitive API querying capabilities.
• Faulkner believes the testing domain will advance in critical areas such as test case prediction, prioritization, and discoverability, which will significantly improve the efficiency and effectiveness of testing efforts.
• SmartBear is determined to continue innovating in these areas over the next 12 months, leveraging the power of generative AI to elevate overall software quality and user satisfaction while remaining responsive to industry trends and customer needs.

This summary was written by Emily Nicholls.