Quantello Test Automation Framework

Overview

Project Overview

Quantello Test Automation Framework is a web-based platform that streamlines test case execution, result analysis, and client management for QA teams.

The system allows QA engineers to:

Upload test cases via Excel (.xlsx) or JSON (.json).
Run automated testing across multiple levels — Unit, Widget, and Integration.
View real-time test results in cards and detailed tables (Test ID, Input, Expected Output, Result, Time, Error).
Maintain a comprehensive history of all past test runs for traceability.
Manage multiple clients, assigning test cases to different projects or organizations.
Track their own performance through a personal profile dashboard with statistics.

This project aimed to build a centralized, easy-to-use test automation dashboard that reduces manual effort, minimizes errors, and empowers QA teams with actionable insights.

The Problem

Quality Assurance (QA) teams often struggle with disconnected tools and manual processes for managing test cases. Key challenges included:

Fragmented workflows: Test cases existed in spreadsheets or JSON files, requiring engineers to run them manually or through different tools.
Lack of standardization: No unified way to categorize or track test cases across Unit, Widget, and Integration levels.
Time-consuming execution: Running tests and manually recording results led to delays and errors.
Poor visibility: QA leads and managers had limited insights into historical results, client-specific test runs, and overall quality trends.
Client complexity: Agencies and teams serving multiple clients had difficulty managing client-specific test data, reporting, and history in one place.

These gaps resulted in wasted time, inconsistent testing, and unreliable reporting, making it difficult for QA teams to scale effectively.

The Goal

The Quantello Test Automation Framework was designed to:

Provide a centralized platform for uploading, executing, and analyzing test cases.
Standardize test categorization into Unit, Widget, and Integration levels for consistency.
Automate test execution and provide real-time results (cards + detailed reports).
Enable multi-client management, ensuring each client’s test history and results are stored separately.
Allow users to export results and maintain a complete test history for traceability.
Support scalability by letting QA teams manage multiple projects, clients, and test runs in one dashboard.
Empower individual QA engineers with profile statistics (tests run, passed, failed, clients managed) to track performance.

Process

Process & Key UX Decisions

Designing Quantello required creating a clear, structured workflow for QA engineers, while also addressing multi-client complexity and ensuring scalability. Below are the major UX decisions:

File Upload & Validation

Supported Excel (.xlsx) and JSON (.json) formats for flexibility.
Drag-and-drop and browse options for easy upload.
Real-time validation with error states for unsupported formats or oversized files.

Why: QA engineers often work with different test formats; supporting both prevents blockers and ensures inclusivity.

Automated Categorization

Automatically sorted uploaded test cases into Unit, Widget, and Integration levels.
Displayed case count and file details immediately after upload.

Why: Reduced manual tagging effort and enforced standardization across all test runs.

Client Selection & Management

Users could assign uploaded test cases to an existing client or add a new client on the spot.
Designed a dedicated client management module with details (industry, contacts, logo, test history).

Why: Agencies often serve multiple clients; keeping tests organized per client improves clarity and accountability.

Running Tests & Real-Time Feedback

Tests ran across three levels (Unit, Widget, Integration).
Execution warnings alerted users that starting a new test would cancel an ongoing one.
Live progress indicators minimized confusion during execution.

Why: Running large test sets can take time; feedback loops and warnings prevent errors and wasted effort.

Results Visualization

Summary cards showed quick stats: Passed, Failed, Total Cases, Execution Time.
Detailed tables displayed: Test ID, Input, Expected Output, Actual Result, Error messages, Execution time in ms.
Export option for results.

Why: QA engineers need both at-a-glance success rates and deep debugging data in one place.

Test History

Centralized log of all test runs, categorized by client, file name, run date, and outcome.
Status indicators (Completed, Cancelled) for transparency.

Why: Historical visibility enables traceability, comparisons, and accountability in QA reporting.

Profile & Performance Dashboard

Profile section with personal stats: total tests run, passed, failed, and clients managed.
Editable profile details (name, contact, role, department).

Why: Helps QA engineers track personal contributions and provides transparency for managers.

Final Design & Screens

The final design of Quantello focused on clarity, structure, and efficiency, ensuring QA engineers could move smoothly from uploading test cases to analyzing results. Here are the key flows and representative screens:

Authentication

Simple, minimal authentication screens reduce barriers to entry. Clear CTAs guide users to sign in or register quickly.

Dashboard & Upload Flow

Drag-and-drop and browse options support diverse user workflows. Immediate feedback on file format/size avoids frustration.

Client Selection & Management

Client-centric design ensures agencies and QA teams can keep projects separate, improving traceability and accountability.

Test Execution & Results

Quick-glance cards give overall status, while detailed tables provide actionable debugging insights (inputs, outputs, errors, execution times).

Test History

Centralized history makes QA processes transparent, enabling trend analysis and audits across clients.

User Profile

Personalized dashboards highlight individual contributions and foster accountability within QA teams.

Impact

Impact & Learnings