The role involves building AI search agents, creating RAG pipelines, optimizing vector search technologies, and automating evaluation processes.
Job Responsibilities
1. Building AI search agents- including ReAct, planning, and multi-agent architectures via custom implementation or frameworks like LangGraph, Dify, or CrewAI.
2. Building end-to-end RAG pipelines from ingestion, chunking, embeddings, and hybrid vector search, ideally using Opensearch.
3. Operating and monitoring vector/hybrid indexes (e.g. OpenSearch) in production environments.
4. Implement grounding and citation to link generated answers back to their exact source passages.
5. Automate evaluation using synthetic QA, retrieval-hit-rate tracking, and model-critique loops to continuously measure accuracy and detect drift.
6. Orchestrating external tools or knowledge bases and monitoring latency and cost at production scale.
Qualifications
1. Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
2. 3+ years of experience in developing AI systems, with a focus on retrieval-augmented generation (RAG).
3. Proven track record in building and optimizing end-to-end RAG pipelines.
4. Experience with AI search agent development using frameworks like ReAct, LangGraph, Dify, or CrewAI.
5. Hands-on experience with OpenSearch or similar vector search technologies.
6. Proficiency in Python and relevant machine learning frameworks (e.g., PyTorch, TensorFlow).
7. Strong understanding of data ingestion, chunking, embeddings, and hybrid vector search techniques.
8. Experience with monitoring and managing production environments.
9. Knowledge of grounding and citation techniques in AI-generated content.
10. Familiarity with synthetic QA datasets and evaluation metrics.
Top Skills
Crewai
Dify
Langgraph
Opensearch
Python
PyTorch
TensorFlow
Similar Jobs
Artificial Intelligence • Cloud • eCommerce • Enterprise Web • Software • Design • Generative AI
As a Senior DevOps Engineer, you'll manage Webflow's build systems, oversee development environments, enforce best practices, and mentor junior team members to enhance efficiency and delivery in software development.
Top Skills:
AWSCi/CdDockerInfrastructure As Code (Iac)KubernetesNode.jsPulumi
Artificial Intelligence • Cloud • eCommerce • Enterprise Web • Software • Design • Generative AI
The Staff Data Scientist will lead projects to drive insights, define business metrics, advance experimentation, and collaborate with various teams to enhance user experience and product performance.
Top Skills:
PythonRSQL
Artificial Intelligence • Cloud • eCommerce • Enterprise Web • Software • Design • Generative AI
The Partner Manager will develop strategies for growing the reseller ecosystem, build relationships with partners, and work cross-functionally to drive mutual growth and success.
Top Skills:
AIBusiness DevelopmentPartner MarketingSaaS
What you need to know about the Calgary Tech Scene
Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.
