What You'll Do
BCG has been on an exciting Generative AI journey, transforming internal operations with cutting edge AI technologies. We are seeking a GenAI Engineer/Manager with strong Data Engineering foundation- someone who has grown from data engineering background into AI/Gen AI and can actively contribute to both the areas, and is passionate about designing, developing, deploying and optimizing Gen AI products at scale.
This role will be hosted in the Data Product Portfolio, and individual will be embedded as part of the Data Engineering Chapter, focusing primarily on GenAI solutions while contributing as a Data Engineer where required.
KEY RESPONSIBILITIES
• Lead end-to-end design, development & deployment of GenAI solutions at scale, ensuring they deliver measurable business outcomes.
• Drive AI/GenAI use cases as an individual coding contributor (IC), from ideation to deployment.
• Fine-tune Large Language Models (LLMs) for business-specific applications, applying agentic AI architectures where relevant.
• Collaborate with data engineers, AI engineers, QA, and other stakeholders to create robust data & AI pipelines, ensuring compliance with data governance and security requirements.
• Contribute to data engineering tasks where needed: developing data pipelines, ensuring data quality, and supporting analytical use cases.
• Share expertise on emerging GenAI tools, frameworks, and methods (Langchain, LlamaIndex, RAG, multi-agent setups).
• Implement MLOps/LLMOps practices, CI/CD pipelines, and guardrails to monitor performance and mitigate risks such as hallucinations.
• Mentor team members in both data engineering best practices and AI engineering approaches.
What You'll Bring
AI/ML & LLM engineering skills
• 7+ years in technology roles, with 5+ years in Data Engineering and 2+ years in GenAI/AI product development at scale.
• Proven experience with Agentic AI architectures, multi-agent systems, or hands-on implementation of RAG pipelines.
• Hands-on coding in Python and exposure to Gen AI frameworks such as LangChain, LlamaIndex, HuggingFace
• Strong understanding of LLMOps/MLOps principles to deploy, monitor models, and implement CI/CD automation.
• Experience with LLM evaluation frameworks, guardrails to evaluate and monitor output quality, and control hallucinations
• Experience in deploying solutions on a cloud platform – AWS (preferred), Azure/GCP with containerization (Docker/Kubernetes).
• Demonstrated problem-solving skills with a track record of innovative solutions to complex challenges
Data Engineering Skills
• Strong knowledge of SQL, dbt (preferable), Airflow, and Snowflake for building and maintaining data pipelines.
• Hands-on experience with ETL/ELT, data modeling, SCD/CDC frameworks, and data quality testing.
• Ability to analyze performance bottlenecks and optimize data pipelines for efficiency and scalability.
• Exposure to version control (GitHub/Bitbucket) and Agile methodologies.
Communication, interpersonal, and teaming skills
• Strong communication and stakeholder engagement skills to explain technical solutions in business language.
• Experience working in a fast-paced global company, with a diverse team of both technical and functional backgrounds, located in multiple time zones
• Proven ability to operate with a transparent mindset, communicating openly with stakeholders at various levels of the organization.