JOB DESCRIPTION:
• 8+ years of proven work experience in Quality Engineering.
• Integrate LLM automation tests into the continuous integration and continuous deployment pipelines. Hands-on experience in prompt engineering concepts.
• Proven experience in developing and implementing automation frameworks for Large Language Models. Strong programming skills in languages such as Python, Java, or similar. Experience with popular testing tools and frameworks (e.g., Selenium, JUnit, TestNG).
• Knowledge of NLP (Natural Language Processing) concepts and techniques.
• Familiarity with CI/CD pipelines and version control systems (e.g., Jenkins, Git).
• Strong problem-solving and analytical skills.
• Experience in automation technologies including Selenium, Junit, Gherkin, Meter etc. and scripting languages including java.
• Proficiency in usage of PostgreSQL and Vector databases(ReDis) or large datasets.
• Team player with good communication skills to work effectively in a global team.
Desired Skills:
• Working knowledge of cloud-based application architecture and principles.
• Prior experience working in the Financial Services Industry
• Familiarity with building large-scale Al products or platforms for NLP, or recommendation systems serving millions of users.
• Familiarity with Graph or Network Theory and Graph ML, including relevant frameworks and libraries such as Deep Graph Learning (DGL) or NER, Levenshtein Distance