Job Posting: GenAI Engineer (LLM/RAG)
Role: GenAI Engineer (LLM/RAG)
Location: San Francisco, CA (Onsite)
Contract: 12+ Months
Job Description:
We are seeking a highly skilled GenAI Engineer (LLM/RAG) with a strong background in Data Engineering and Software Development to enhance our information retrieval and generation capabilities. The ideal candidate will have expertise in Azure AI Search, data processing for RAG, multimodal data integration, and familiarity with Databricks.
In this role, you will be responsible for developing a comprehensive framework for data ingestion (vector databases and text-to-SQL) to ensure seamless integration and accessibility of data. This framework will be consumed by an LLM-based chatbot to optimize and enhance semiconductor manufacturing processes.
Requirements:
-
10-12+ years of experience in GenAI, LLM, MLOps, Python, RAG Pipelines, Azure AI, and Databricks.
-
8+ years of experience in Data Science, MLOps, and Data Engineering.
- Proven experience in AI and ML solution implementation within semiconductor manufacturing.
- Strong programming skills in Python.
- Hands-on experience in building and deploying RAG pipelines or similar information retrieval systems.
- Familiarity with processing multimodal data (text, images) for retrieval and generation tasks.
- Expertise in SQL and NoSQL database systems and data warehousing solutions.
- Proficiency in Azure AI, Databricks, and other cloud-based AI solutions.
- Strong problem-solving skills and the ability to work independently and collaboratively.
-
Excellent communication skills for conveying technical concepts to non-technical stakeholders.
- Experience in developing and deploying scalable ML models in production environments.
-
Bachelor’s degree in Computer Science, Data Science, or a related field (Master’s degree preferred).
Key Responsibilities:
-
Design, develop, and optimize Retrieval-Augmented Generation (RAG) models to improve information retrieval and generation processes.
- Develop and maintain search solutions using Azure AI Search to ensure efficient and accurate information access.
- Process and prepare data to support RAG workflows, ensuring data quality and relevance.
- Integrate and manage various data types (text, images) to enhance retrieval and generation capabilities.
- Work closely with cross-functional teams to integrate data into our existing retrieval ecosystem.
- Ensure the scalability, reliability, and performance of data retrieval in production environments.
- Stay updated with the latest advancements in AI, ML, and data engineering to drive innovation.
Projects Include:
-
Azure AI Search Indexing: Implementing advanced search indexing solutions using Azure AI to enhance data accessibility and retrieval.
-
LLM RAG Chatbot: Supporting the development of a chatbot using RAG to improve customer support and interaction.