Paradigm is a software company transforming the way that the residential construction & building product industries operate across the globe. We are looking for an Analyst - AI to be part of revolutionizing these industries. If you love data-cleaning it, digging in it, understanding what type of insights stakeholders want from it and helping them navigate through it-let’s talk.

The Analyst – AI will be part of a centralized AI team that develops scalable computer vision and large language model (LLM)-based solutions. This person will ensure that AI outputs are tested, trusted, and ready for integration by distributed product teams.

What You Will Do:

• You will collaborate closely with AI scientists and developers to rigorously validate computer vision and large language models (LLMs), ensuring their accuracy, performance, and reliability. You will also fine-tune deployment artifacts and streamline the delivery of models, particularly those built on or deployed with Azure AI services.
• You will evaluate AI models using both quantitative and qualitative methods, incorporating feedback from product teams to drive iterative improvements.
• You will prepare comprehensive documentation detailing API behaviors, model interfaces, and integration guidelines for product teams.
• You will function as the liaison between the AI team and product teams, facilitating seamless integration of AI solutions into products.
• You will employ off-the-shelf models and services (e.g., Azure Cognitive Services, OpenAI, Meta Llama) to prototype or extend existing AI capabilities.
• You will work alongside data scientists, ML engineers, and product managers to refine data inputs and business use cases.
• You will develop dashboards and reports that summarize AI model performance and its impact on the business for both technical and non-technical audiences.
• You will stay current with trends in AI/ML, MLOps, and contribute to internal knowledge-sharing initiatives.
• You will provide feedback on data definitions, transformations, and usage patterns to help ensure consistency between AI outputs and downstream reporting needs (providing context, guidance, and validation).
• You may configure and fine-tune pre-built AI models using Azure ML Studio or other low-code/no-code tools.
• You may assist with data preparation, feature engineering, or lightweight model experimentation using Python, SQL, or notebooks.
• You may participate in model governance processes and help maintain documentation for explainability and auditability.
• You may evaluate third-party AI solutions for potential integration into internal workflows.

What You Need to Succeed:

• You will have a bachelor’s degree in Computer Science, Data Science, or a related field, or equivalent experience.
• You will have 3+ years of experience in AI, data analysis, or technical QA roles.
• You have experience writing and modifying basic to intermediate SQL queries, primarily for validating AI inputs/outputs, inspecting data sources, or troubleshooting integrations across Azure services.
• Familiarity with Databricks and Power BI is important for collaborating with the reporting and data engineering teams.
• You possess strong analytical skills with a proven ability to evaluate complex data sets and validate model outputs, such as image classifications and LLM responses. This will be for quality, reliability, and edge cases, enabling you to draw meaningful conclusions and make informed recommendations.
• You will need critical thinking, requirement gathering skills, and proven problem-solving skills.
• You will have practical experience with Azure Cognitive Services, particularly Computer Vision, Custom Vision, and Azure OpenAI.
• You have excellent customer service and effective communication (both written & verbal). Including the ability to translate technical concepts to people without technical expertise.
• You are highly organized with strong attentive to detail and excellent follow-through. You are agile and able to adapt to changing demands and manage multiple priorities in a fast-paced environment
• You are self-motivated and resourceful, with strong interpersonal skills; able to work individually as well as with a team.
• You have competence with API testing and integration tools such as Postman, solid understanding of REST APIs, JSON, and authentication flows.
• You have experience working with cross-functional teams including developers, AI scientists, and product managers.
• You are familiar with LLM concepts (prompt tuning, hallucination detection, output evaluation).
• You have knowledge of MLOps pipelines or Azure ML Studio workflows.
• You have experience with version control systems (e.g., Git), notebooks (e.g., Jupyter), and lightweight scripting languages (e.g., Python).
• You understand Agile processes and integration testing in production-like environments.
• If you have construction and architectural industry knowledge/experience that is a bonus!

Ready to Join? Apply now! MyParadigm.com/careers/

Individual compensation packages are based on various factors unique to each candidate, including skill set, experience, qualifications, and other job-related reasons. Most roles at Paradigm have three levels, Associate, Mid and Senior. Our pay ranges are inclusive of all three levels (if applicable), our US based Associate level pay begins at $65,000 annually for this role. The salary does not reflect total compensation, which includes base salary and benefits. These compensation levels are subject to an annual review. #paradigm