AI Engineer - Prompt

Overview

This is a 6 month onsite engagement in Redmond, WA with no possibility for extension.

Join a pioneering technology leader dedicated to shaping the future of human-computer interaction. This organization is at the forefront of integrating advanced AI capabilities into widely used productivity platforms, empowering millions globally to achieve more. As an Aquent talent, you will play a crucial role in driving innovation and enhancing user experiences within a dynamic and impactful environment.

Are you a visionary professional passionate about crafting intelligent conversations and ensuring seamless user experiences within AI systems? We are seeking a talented individual to join a forward-thinking team focused on developing the core services that power next-generation intelligent assistant features. In this pivotal role, you will directly influence how users interact with AI, transforming complex tasks into intuitive and engaging dialogues. Your expertise will be vital in evaluating, testing, and refining the prompts that define the intelligence of these systems, making a tangible impact on global productivity.

About the Role
You will contribute to the evolution of intelligent assistant features within core productivity applications. Your work will involve critical evaluations for prompts, hands-on manual and automated testing, setting up robust test environments, and executing coding activities essential for supporting these evaluations. This is an opportunity to be at the heart of AI development, ensuring the quality and effectiveness of cutting-edge conversational interfaces.

Key Responsibilities

• Design and craft conversational prompts, messages, and responses for AI chatbots and virtual assistants.
• Create prompts that align with organizational objectives, provide a seamless user experience, and ensure effective interactions between users and AI systems.
• Develop a library of pre-defined prompts tailored to various scenarios and user needs.
• Fine-tune and improve a variety of sophisticated software implementation projects.
• Gather and analyze system requirements, document specifications, and develop software solutions to meet diverse needs.
• Analyze and review enhancement requests and specifications.
• Implement system software and customize requirements.
• Prepare detailed software specifications and test plans.
• Code new programs to specifications and create test data for testing.
• Modify existing programs to new standards and conduct unit testing of developed programs.
• Create migration packages for system testing, user testing, and implementation.
• Provide quality assurance reviews.
• Perform post-implementation validation of software and resolve any bugs found during testing.

Must-Have Qualifications

• Bachelor’s degree in a technical field such as computer science, computer engineering, or a related discipline.
• 2-4 years of professional experience.
• Ability to setup synthetic tenant data and data ingestion – test accounts, generate grounding data, configuration as code
• Maintain, validate, and automate the creation of test datasets for an LLM evaluation system
• Integrate evaluation quality checks in our build and deployment pipeline, ensuring performance and scalability
• A solid foundation in computer science, including strong competencies in data structures, algorithms, and software design.
• Experience with large systems software design and development.
• Proven experience performing in-depth troubleshooting and unit testing with both new and legacy production systems.
• Experience in programming and with problem diagnosis and resolution.

Nice-to-Have Qualifications

• Prior experience with Large Language Model (LLM) evaluation.
• Background in data science and experimentation.

About Aquent Talent
Aquent Talent connects the best talent in marketing, creative, and design with the world’s biggest brands.
Our eligible talent get access to amazing benefits like subsidized health, vision, and dental plans, paid sick leave, and retirement plans with a match. More information on our awesome benefits!
Aquent is an equal-opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics. We’re about creating an inclusive environment—one where different backgrounds, experiences, and perspectives are valued, and everyone can contribute, grow their careers, and thrive.