• HOME
  • CATEGORIES

    • CATEGORIES

    • Application Development

      • Observability Platforms
      • Integrated Development Environment (IDE) Software
      • Enterprise Agile Planning Tools
      • Integration Platform as a Service
      • AI-Augmented Software Testing Tools
      • View All
    • Artificial Intelligence

      • AI Code Assistants (Transitioning to AI Coding Agents)
      • Generative AI Knowledge Management Apps/General Productivity
      • AI Application Development Platforms
      • Conversational AI Platforms
      • Artificial Intelligence Applications in IT Service Management (Transitioning to AI Applications in IT Service Management)
      • View All
    • Cloud Computing

      • Backup and Data Protection Platforms
      • Cloud Database Management Systems
      • Strategic Cloud Platform Services
      • Server Virtualization (Transitioning to Server Virtualization Platforms)
      • Hybrid Cloud Storage
      • View All
    • Customer Relationship Management

      • Contact Center as a Service
      • CRM Customer Engagement Center
      • Digital Experience Platforms
      • Web Content Management
      • Field Service Management
      • View All
    • Data and Analytics

      • Analytics and Business Intelligence Platforms
      • Data Science and Machine Learning Platforms (Transitioning to AI Platforms For Data Science and Machine Learning)
      • Data Integration Tools
      • Process Mining Platforms (Transitioning to Process Intelligence Platforms)
      • Metadata Management Solutions
      • View All
    • Education

      • Manager and Leadership Training
      • Corporate Learning Technologies
      • eLearning Authoring Tools
      • Higher Education Student Information System Software as a Service (Transitioning to Higher Education SaaS Student Information Systems)
      • Digital Learning Content Providers
      • View All
    • Enterprise Networking and Communications

      • Unified Communications as a Service
      • Global WAN Services
      • Edge Distribution Platforms
      • Intranet Packaged Solutions
      • SD-WAN
      • View All
    • Finance

      • Expense Management Software
      • Financial Close and Consolidation Solutions
      • Financial Planning Software
      • Cloud Financial Management Tools
      • Accounts Payable Applications
      • View All
    • Healthcare and Life Sciences

      • Medical Device Security Solutions (Transitioning to Medical Device Risk Management Platforms)
      • Health Navigation Solutions
      • Claim Editor Software
      • Revenue Cycle Management Software (Transitioning to Revenue Cycle Management Solutions)
      • Digital Health Platforms (Transitioning to Healthcare Provider Industry Cloud Platforms)
      • View All
    • Human Resources

      • Employee Recognition and Reward Systems
      • Workforce Management Applications (Transitioning to Workforce Management (WFM) Technology)
      • Digital Employee Experience Management Tools
      • Talent Acquisition (Recruiting) Suites
      • Cloud HCM Suites for Regional and/or Sub-1,000 Employee Enterprises
      • View All
    • IT Infrastructure and IoT

      • Enterprise Wired and Wireless LAN Infrastructure (Transitioning to Enterprise Wired and Wireless LAN)
      • IT Service Management Platforms
      • Endpoint Management Tools
      • Container Management
      • Infrastructure Monitoring Tools
      • View All
    • IT Security

      • Endpoint Protection Platforms
      • Email Security
      • Managed Detection and Response
      • Security Information and Event Management
      • Identity Governance and Administration
      • View All
    • Legal

      • Contract Life Cycle Management
      • Electronic Signature
      • Governance, Risk and Compliance Tools, Assurance Leaders
      • Compliance Monitoring Solutions
      • Corporate Governance Services
      • View All
    • Manufacturing

      • Enterprise Asset Management Software
      • Manufacturing Execution Systems
      • Global Industrial IoT Platforms
      • PLM Software in Discrete Manufacturing Industries
      • Computer-Aided Design (CAD) Software
      • View All
    • Marketing

      • Video Editing Software
      • Email Marketing
      • Multichannel Marketing Hubs
      • Voice of the Customer Platforms
      • Customer Data Platforms
      • View All
    • Productivity and Collaboration

      • Document Management
      • Collaborative Work Management
      • Visual Collaboration Applications
      • Knowledge Management (KM) Software
      • Adaptive Project Management and Reporting
      • View All
    • Public Sector and Government

      • Government ERP Solutions
      • Government Budgeting and Planning Solution
      • Cloud-Based ERP for U.S. Local Government
      • Citizen Service Delivery
      • Government Contracting Software
      • View All
    • Retail

      • Digital Commerce
      • Digital Commerce Payment Vendors (Transitioning to Digital Commerce Payment Platforms)
      • Retail Workforce Management Applications (Transitioning to Retail Workforce Management Technology)
      • Retail Assortment Management Applications: Long Life Cycle Products
      • Digital Shelf Analytics
      • View All
    • Sales

      • Revenue Enablement Platforms
      • Configure, Price and Quote Applications
      • Sales Force Automation Platforms (Transitioning to CRM Sales Platforms)
      • Revenue Intelligence (Transitioning to Revenue Action Orchestration)
      • Sales Performance Management
      • View All
    • Supply Chain Management

      • Supply Chain Planning Solutions
      • Transportation Management Systems
      • Real-Time Transportation Visibility Platforms
      • Warehouse Management Systems
      • Supply Chain Strategy, Planning and Operations Consulting
      • View All
    • Utilities

      • Geospatial Information Systems for Energy and Utilities
      • Mobile Workforce Management Software for Utilities (Transitioning to Mobile Workforce Management Solutions for Power and Utilities)
      • Energy Management and Optimization Systems
      • Energy Trading and Risk Management
      • Advanced Distribution Management Systems
      • View All
    • Browse All Categories
  • FOR VENDORS

    • FOR VENDORS

    • Log In to Vendor Portal
    • Get Started
  • REVIEWS

    • REVIEWS

    • Write a Review
    • Product Reviews
    • Vendor Directory
    • Product Comparisons
  • GARTNER PEER COMMUNITY™
  • GARTNER.COM
  • Community GuidelinesListing GuidelinesBrowse VendorsRules of EngagementFAQPrivacyTerms of Service
    ©2026 Gartner, Inc. and/or its affiliates.
    All rights reserved.
  • Categories

      • Application Development
      • Artificial Intelligence
      • Cloud Computing
      • Customer Relationship Management
      • Data and Analytics
      • Education
      • Enterprise Networking and Communications
      • Finance
      • Healthcare and Life Sciences
      • Human Resources
      • IT Infrastructure and IoT
      • IT Security
      • Legal
      • Manufacturing
      • Marketing
      • Productivity and Collaboration
      • Public Sector and Government
      • Retail
      • Sales
      • Supply Chain Management
      • Utilities
      Browse All Categories

      Application Development

      69 markets
      • Observability Platforms
      • Integrated Development Environment (IDE) Software
      • Enterprise Agile Planning Tools
      • Integration Platform as a Service
      • AI-Augmented Software Testing Tools
      • API Management
      • Enterprise Low-Code Application Platforms
      • Robotic Process Automation
      • Business Process Automation Tools
      • Business Orchestration and Automation Technologies
      • DevOps Platforms (Transitioning to DevSecOps Platforms)
      • Enterprise Architecture Tools
      • Custom Software Development Services
      • Code Review Tools
      • Digital Adoption Platforms
      • Domain Registrars
      • Game Engine Software
      • Website Builders
      • Public Cloud IT Transformation Services (Transitioning to Public Cloud Optimization and Transformation Services)
      • Developer Productivity Insight Platforms
      • API Generation Software
      • AI Agents for Application Developers
      • Feature Management
      • Application Platforms (Transitioning to Cloud-Native Application Protection Platforms)
      • Application Crowdtesting Services
      • Prototyping Software
      • Mobile App Analytics
      • Test Data Management
      • Virtual Reality Development Software
      • Green Software Engineering
      • Application Testing Services, Worldwide (Transitioning to Quality Engineering Services)
      • Application Integration Platforms
      • Event Brokers
      • AI-Augmented Code Modernization Tools
      • Independent Third-Party Software Support of Megavendors
      • Application Development Life Cycle Management (Transitioning to DevOps Platforms)
      • Digital Twin of an Organization Platforms
      • Microsoft 365 Implementation and Support Services
      • BPM-Platform-Based Case Management Frameworks
      • Microsoft Product Support Services
      • Product Roadmapping Tools for Software Engineering
      • AI Agent Development Platforms for Software Engineering
      • Multiexperience Development Platforms
      • Application Composition Platform
      • Application Portfolio Management Tools
      • Internal Developer Portals
      • Load Testing Tools
      • Mobile Development Frameworks
      • Cloud Development Environments
      • B2B Gateway Software
      • SAP S/4HANA Application Services, Worldwide (Transitioning to Cloud ERP Services)
      • Blockchain Consulting and Proof-of-Concept Development Services
      • Citizen Application Development Platforms
      • Mobile Application Testing Services
      • Value Stream Management Platforms
      • API and MCP Testing Tools
      • Oracle Cloud Application Services, Worldwide (Transitioning to Cloud ERP Services)
      • SAP Application Services, Worldwide
      • SAP SuccessFactors Service Providers (Transitioning to Cloud ERP Services)
      • Service Mesh
      • Business-Outcome-Driven Enterprise Architecture Consulting (Retired)
      • Oracle Application Services, Worldwide (Transitioning to Cloud ERP Services)
      • Rapid Mobile App Development Tools
      • SAP Selective Test Data Management Tools
      • Augmented Reality Development Software
      • Blockchain as a Service
      • Mobile Application Management (Transitioning to Endpoint Management Tools)
      • Mobile Back-End Services
      • R&D Outsourcing Providers
      View More
  • For Vendors

    • Log In to Vendor Portal 

    • Get Started 

  • Write a Review

Join / Sign In
  1. Home
  2. /
  3. TestNG Open Source Framework
Logo of TestNG Open Source Framework

TestNG Open Source Framework

byTestNG
in Application Development
4.3

Overview

Overall experience with TestNG Open Source Framework

ENGINEER M4
10B - 30B USD, Consumer Goods
FAVORABLE

“Exploring TestNG's Powerful Features and Flexibility for QA Engineers”

4.0
Sep 3, 2024
My overall experience with TestNG as QA Engineer has been largely positive, mostly because of its flexibility, powerful features and ease of use for Java-based projects. It excels in complex scenarios requiring parallel execution. Meanwhile, it could be better in assertion library. With some enhancements TestNG could be the best choice for QA Engineers in automated testing environments.
Engineer
<50M USD, IT Services
CRITICAL

“Very flexible Open Source tool used in the Projects Mainly in Automation”

3.0
Apr 1, 2019
It is one of the best framework used in the automation of applications while supporting parallel execution and test execution based on priority and in the selected order. TestNg is of the most used framework in our organization due to its unique features such as Data Driven , listeners. its provides flexibility and very easy to learn and implement it in the real time and it is a widely used framework and we can also find very helpful tutorials online to learn with very good examples

About Company

Key Insights

A Snapshot of What Matters - Based on Validated User Reviews

Reviewer Insights for: TestNG Open Source Framework
Deciding Factors: TestNG Open Source Framework Vs. Market Average

TestNG Open Source Framework Likes & Dislikes

Like

- Ease of use - Intuitive annotations like '@Test', '@BeforeMethod' and '@BeforeClass'. Data-driver testing with '@DataProvider' annotation allow to reuse same test to be reused with different inputs. Flexible test configuration, XML based file easy to understand, change and support - Parallel testing - TestNG supports parallels which is essential in my opinion - Integration with build tools - integrates seamlessly with build tools like Maven and Gradle - Documentation - TestNG has a robust community and extensive documentation, which makes easier to find any solution you might need

Like

Its an open source tool which provides options like reporting, parallel execution and very useful annotations

Like

TestNG makes your life much easier by providing some common asks very easily. You can have dependencies on methods, so that the dependent cases will skip of the depending method fails, you have number of threads to configure, invocation count, data provider (to provide different kinds of parameters to an API) so that you dont need to write multiple test cases to test a single API with different parameters, and many more things. It is also very well integrated with Maven. And it provides a descriptive report.

Dislike

- Complexity for large projects - as project grows XML files can become cumbersome. - Limited build-in Assertions - really lacks extensive assertions from AssertJ (but we can use both at the same time)

Dislike

None I can think about

Dislike

Chrome driver version was outdated and so has to fix it manually by updating it.

Top TestNG Open Source Framework Alternatives

Peer Discussions

TestNG Open Source Framework Reviews and Ratings

4.3

(46 Ratings)

Rating Distribution

5 Star
46%
4 Star
52%
3 Star
2%
2 Star
0%
1 Star
0%
Why ratings and reviews count differ?

Customer Experience

Evaluation & Contracting

4.5

Integration & Deployment

4.5

Service & Support

4.4

Product Capabilities

4.5

Filter Reviews
Sort By:
Most helpful
Last 12 Months
Star Rating
Reviewer Type
Reviewer's Company Size
Reviewer's Industry
Reviewer's Region
Reviewer's Job Function
  • ENGINEER M4
    10B+ USD
    Consumer Goods
    Review Source

    Exploring TestNG's Powerful Features and Flexibility for QA Engineers

    4.0
    Sep 3, 2024
    My overall experience with TestNG as QA Engineer has been largely positive, mostly because of its flexibility, powerful features and ease of use for Java-based projects. It excels in complex scenarios requiring parallel execution. Meanwhile, it could be better in assertion library. With some enhancements TestNG could be the best choice for QA Engineers in automated testing environments.
  • Associate Engineer
    10B+ USD
    IT Services
    Review Source

    TestNG - truly Test Next Generation

    5.0
    Mar 26, 2021
    There are features which makes it stand out in the market and makes it the most preferable framework for automation. features like : Ability to produce HTML Reports of execution , Ability to produce HTML Reports of execution, parallel testing makes automation more easier and reliable. The ease it provides to integrate testNG to Gradle and Marven makes it the first choice. testNG provides features which makes testing way easier. Control the order of execution and enabling/disabling a test case, additional setup/teardown methods makes automation scripts easier and reliable. It truly provides solution to every drawback which could come into automation testing. From detecting the pass or failure of the tests , repeat a part of code to test the calls for some 1-100 times using for loop, generating reports in XML and HTML form.
  • Engineer
    10B+ USD
    IT Services
    Review Source

    A Must Use Framework Tool

    5.0
    Mar 26, 2021
    I have been using it from the starting. Its been a fantastic framework which makes the work quite easier whether it's Batch execution, parallel execution. Everything is interesting & easy to use.
  • Senior Developer
    1B-10B USD
    IT Services
    Review Source

    TestNG - the heart of testing project

    5.0
    Mar 16, 2021
    Testng is a great testing framework when it comes to writing readable and maintainable test scripts. it allow us to write clean tests and manage the same without much configuration. because of Testng we can control the flow of test execution as well as we can generate beautiful html reports.
  • Programmer Analyst
    50M-1B USD
    Retail
    Review Source

    The Next Generation Automation Framework

    4.0
    Aug 28, 2020
    One of the robust framework which got inspired by the JUnit and NUnit and its major goal is to cover the wider range of test categories like End to End testing, Functional and integration testing and it also provided us with Annotations by which we can prioritize and group our test case execution and its pretty easy to install TestNG and it also provides a HTML reports for our execution. In our last project it supported greatly by providing us Parallel testing and running the failed test cases and getting the report on same.
...
Showing Result 1-5 of 46

Recommended Gartner Insights

Gartner Peer Insights content consists of the opinions of individual end users based on their own experiences, and should not be construed as statements of fact, nor do they represent the views of Gartner or its affiliates. Gartner does not endorse any vendor, product or service depicted in this content nor makes any warranties, expressed or implied, with respect to this content, about its accuracy or completeness, including any warranties of merchantability or fitness for a particular purpose.

This site is protected by hCaptcha and its Privacy Policy and Terms of Use apply.


Software reviews and ratings for EMMS, BI, CRM, MDM, analytics, security and other platforms - Peer Insights by Gartner
Community GuidelinesListing GuidelinesBrowse VendorsRules of EngagementFAQsPrivacyTerms of Use

©2026 Gartner, Inc. and/or its affiliates.

All rights reserved.