Automation Tester

Automation Tester – AI Product Factory is responsible for designing, developing, and maintaining automated testing solutions to ensure the quality, reliability, performance, and security of AI products and platforms. The role works closely with AI engineers, platform engineers, and product teams to validate Generative AI and Large Language Model (LLM) applications, APIs, and platform components through automated testing and continuous quality assurance.

The role supports enterprise-scale AI services by implementing automated functional, integration, API, performance, and end-to-end testing, integrating tests into CI/CD pipelines, and ensuring platform stability and quality across the software development lifecycle.

Key Responsibilities:

• Design, develop, and maintain automated test frameworks and reusable test scripts for AI applications, APIs, and web interfaces.

• Develop functional, regression, smoke, and end-to-end test suites.

• Create automated validation for LLM-based applications and AI workflows.

• Execute automated tests and analyze results.

• Develop and execute automated tests for REST, GraphQL, and gRPC APIs.

• Validate integrations between AI services, databases, vector stores, and external systems.

• Verify request/response accuracy and error handling.

• Perform schema and contract validation.

• Validate LLM inference APIs and AI service outputs.

• Develop automated test scenarios for Retrieval-Augmented Generation (RAG), prompt workflows, and AI agents.

• Verify response consistency, latency, and reliability.

• Support evaluation and benchmarking of AI models.

• Integrate automated tests into CI/CD pipelines.

• Implement quality gates and automated regression testing.

• Support continuous testing in GitLab CI/CD, Jenkins, or GitHub Actions environments.

• Ensure test execution as part of deployment workflows.

• Perform API and load testing for AI services.

• Validate throughput, response time, and scalability requirements.

• Support stress and endurance testing.

• Identify performance bottlenecks and collaborate with engineering teams for resolution.

• Log, track, and validate defects.

• Collaborate with developers and AI engineers to reproduce and resolve issues.

• Perform root-cause analysis and verification testing.

• Maintain test cases, automation scripts, and quality documentation.

• Produce test execution reports and quality metrics.

• Provide recommendations for continuous quality improvements.

Technical Skills:

• Playwright

• Selenium

• Cypress

• Robot Framework

• Appium

• Postman

• RestAssured

• Swagger/OpenAPI

• GraphQL testing

• Java

• Python

• JavaScript / TypeScript

• JMeter

• K6

• Locust

• GitLab CI/CD

• Jenkins

• GitHub Actions

• Docker

• Kubernetes

• PostgreSQL

• MySQL

• MongoDB

• Redis

• Jira

• Xray

• TestRail

• Prometheus

• Grafana

• ELK Stack

• Git