AI Engineer
Work Schedule
Standard (Mon-Fri)
Environmental Conditions
Office
Job Description
Qualifications:
Education and Experience:
Bachelor's degree or equivalent and relevant formal academic / vocational qualification
Master's degree preferred
Previous experience that provides the knowledge, skills, and abilities to perform the job (minimum
2+ years).
In some cases, an equivalency, consisting of a combination of appropriate education, training.
and/or directly related experience, will be considered sufficient for an individual to meet the
requirements of the role.
Knowledge, Skills, and Abilities:
- Veeva AI & SaaS AI Evaluation
- Ability to evaluate vendor-provided AI capabilities (specifically Veeva AI) where model internals are not directly accessible.
- Experience assessing AI behavior for quality, consistency, failure modes, latency, and operational constraints in enterprise workflows.
- Ability to distinguish when a SaaS AI capability should be adopted as-is, adapted with platform guardrails, or rejected in favor of a custom internal solution.
- Generative AI Systems Understanding
- Strong understanding of generative AI behavior, including non-determinism, hallucination risk, prompt sensitivity, and configuration-driven outcomes.
- Experience applying lightweight evaluation techniques for generative AI (e.g., task-specific test cases, accuracy checks, hallucination tracking, refusal behavior).
- Ability to reason about AI suitability in regulated or high-impact decision contexts.
- AI Evaluation, Validation, and Documentation
- Proficiency in documenting AI evaluations in clear, audit-ready formats, including data flows, decision points, risks, and mitigations.
- Ability to partner with AI governance functions to support model cards, validation summaries, and AI registry or approval artifacts.
- Experience supporting audit and compliance reviews through evidence collection (logs, configurations, access controls).
- Platform Integration & AI Guardrails
- Ability to integrate SaaS AI capabilities into enterprise platforms using approved architectural patterns.
- Experience designing and implementing integration “shims” such as additional logging, input/output filtering, workflow controls, or human-in-the-loop steps.
- Understanding of AI telemetry requirements, including latency, error handling, usage tracking, and cost observability.
- Technical Proficiency
- Strong proficiency in Python and modern SQL for integration, analysis, and validation tasks.
- Experience working with REST APIs, SaaS integrations, and enterprise authentication and authorization patterns.
- Familiarity with Databricks concepts (jobs, notebooks, MLflow) and cloud data storage patterns (e.g., Azure Blob or S3-equivalent).
- Operating in Regulated Environments
- Experience working within regulated, validated, or compliance-driven environments (e.g., clinical research, life sciences, healthcare).
- Ability to operate within defined separation of duties across build, review, and operate phases.
- Comfort working in documentation-first and control-oriented delivery models.
- Collaboration and Ways of Working
- Proven ability to work effectively in a multi-functional, matrixed environment across Product, Platform Engineering, AI Governance, and external vendors.
- Strong written and verbal communication skills, with the ability to explain technical AI behavior and risks to non-technical stakeholders.
- Ability to manage multiple concurrent evaluations and priorities in the context of evolving vendor roadmaps and business needs.
Management Role:
No management responsibility
Working Conditions and Environment:
- Work is performed in an office environment with exposure to electrical office equipment.
- Occasional drives to site locations with occasional travel both domestic and international.
Physical Requirements:
Frequently stationary for 6-8 hours per day.
Repetitive hand movement of both hands with the ability to make fast, simple, repeated movements
of the fingers, hands, and wrists.
Frequent mobility required.
Occasional crouching, stooping, bending and twisting of upper body and neck.
Light to moderate lifting and carrying (or otherwise moves) objects including luggage and laptop
computer with a maximum lift of 15-20 lbs.
Ability to access and use a variety of computer software developed both in-house and off-the-shelf.
Ability to communicate information and ideas so others will understand; with the ability to listen to
and understand information and ideas presented through spoken words and sentences.
Frequently interacts with others to obtain or relate information to diverse groups.
Works independently with little guidance or reliance on oral or written instructions and plans work
schedules to meet goals. Requires multiple periods of intense concentration.
Performs a wide range of variable tasks as dictated by variable demands and changing conditions
with little predictability as to the occurrence. Ability to perform under stress. Ability to multitask.
Regular and consistent attendance.
Percent Billable:
0% - 20%