Talent.com
No longer accepting applications
Global IT LLM Engineer Manager

Global IT LLM Engineer Manager

Boston Consulting GroupAtlanta, GA, United States
4 hours ago
Job type
  • Full-time
Job description

Locations : Boston | Atlanta

Who We Are

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.

Applying for this role is straight forward Scroll down and click on Apply to be considered for this position.

To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.

What You'll Do

WHAT YOU’LL DO

To realize our aspirations to build a Gen AI assistant that will transform the way BCG works, we are looking for LLM engineers who are passionate about designing, developing, and optimizing GenAI products. You will work within the LLM Squad and your Squad Leader in your domain of expertise, helping to advance the work and using your experience to maximize Squad performance. You will bring expertise in full stack development, Performance, and stability of custom-built products. This role is involved in all aspects of LLM based application including LLM expertise, Data science / ML, backend development including API and core functional logic. Work would also involve documentation of all designs and development.

Among your responsibilities, you will :

  • Continuously developing your expertise :

Keeping your technical skills and knowledge sharp, ensuring you remain up-to-date with the latest industry trends and innovations, both internally and externally.

  • Staying well-versed in the tools, methods, and technologies that best serve your team’s needs.
  • Sharing knowledge and expertise :
  • Actively contributing to knowledge-sharing within your team and across related teams, ensuring alignment with technical roadmaps and guidelines.

  • Bringing insights from your domain expertise to discussions, helping to guide technical direction and best practices.
  • Contributing to the Squad’s success :
  • Working with your Squad to achieve its mission by advancing tasks based on the priorities set by the Product Owner.

  • Collaborating cross-functionally, leveraging your expertise to support the Squad’s goals and deliver impactful results.
  • Identifying and supporting resource needs :
  • Identifying where technical expertise is needed and suggesting ways to fill any gaps, whether through your own contributions, training, or advocating for new resources.

  • Adapting to the organization’s new ways of working :
  • Actively embracing and supporting the organization’s new working models, including Agile practices.

  • Contributing to a positive and collaborative team culture by embodying the values of the new way of working
  • YOU’RE GOOD AT

  • Being a highly skilled Senior AI and LLM Engineer.
  • Executing both planning and hands-on technical work independently.
  • Collaborating effectively with Product Owners and other stakeholders to solve complex problems.
  • Working cross-functionally to contribute to impactful solutions across teams.
  • Continuously developing your technical expertise and staying up-to-date with new technologies.
  • Being passionate, intellectually curious, and driven to expand your skills and knowledge.
  • Using a data-driven approach to solve technical challenges and make informed decisions.
  • Applying your systems-level thinking, integrating both data science and engineering principles.
  • Taking full ownership of the features and projects you work on, delivering high-quality solutions on your own.
  • What You'll Bring

  • BA degree in Computer Science, Statistics, or related field with a focus on Artificial Intelligence, Machine Learning, or Natural Language Processing
  • 2+ years of experience developing and experimenting with LLMs
  • 3+years of experience developing AI / ML technologies within large and business critical applications
  • Experience & Skills (Mandatory)

  • Proficiency in Python and all associated DS libraries and frameworks
  • Strong knowledge in AI, machine learning, and natural language processing
  • Experience with leveraging, training and fine-tuning Foundation Models, including multimodal inputs and outputs
  • Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic) and LLM Frameworks (e.g. LangChain, LlamaIndex)
  • Experience with multi-agent frameworks / systems and an understanding of multi-agent systems and their applications in complex problem-solving scenarios.
  • Experience with unstructured.io or similar libraries for handling various document formats and extracting structured information from unstructured data.
  • Expertise in using LlamaIndex for building and querying knowledge bases, including its data connectors, indexing strategies, and query engines.
  • Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets.
  • Proficiency in generating and working with text embeddings using models like BERT, GPT, or domain-specific embedding models. Understanding of embedding spaces and their applications in semantic search and information retrieval.
  • Experience in constructing and querying knowledge graphs, including technologies like Neo4j or RDF triplestores. Understanding of ontology design and graph-based reasoning.
  • Experience with RAG concepts and fundamentals (vectorDBs, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with generative AI models.
  • Experience & Skills (Nice to have)

  • Experience with cloud infrastructure for AI / ML
  • Experience with LLM guardrails
  • Exeprience with LLM monitoring and observability
  • Experience with security related to LLM integration
  • Additional info

  • For US locations only
  • In the US, we have a compensation transparency approach.

    Total compensation for this role includes base salary, annual discretionary performance bonus, retirement contribution, and a market leading benefits package described below.

  • The base salary range for this role begins at $124,000.00 in our lowest cost US region and goes up to $163,333.33 in our highest cost US region. Your recruiting contact can share more about the specific salary range for your preferred location during the hiring process.
  • This is an estimated range, however, specific base salaries within the range depend on various factors such as experience and skill set. It is not common for new BCG employees to be hired at the high-end of the salary range. BCG regularly reviews its ranges to ensure market competitiveness.

    In addition to your base salary, your total compensation will include a bonus of up to 16% and a generous retirement contribution that starts at 5% and moves to 10% after 2 years.

    All of our plans provide best in class coverage :

  • Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children
  • Low $10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugs
  • Dental coverage, including up to $5,000 in orthodontia benefits
  • Vision insurance with coverage for both glasses and contact lenses annually
  • Reimbursement for gym memberships and other fitness activities
  • Fully vested Profit Sharing Retirement Fund contributions made annually, whether you contribute or not, plus the option for employees to make personal contributions to a 401(k) plan
  • Paid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursement
  • Generous paid time off including 12 holidays per year, an annual office closure between Christmas and New Years, and 15 vacation days per year (earned at 1.25 days per month)
  • Paid sick time on an as needed basis
  • Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.

    BCG is an E - Verify Employer. Click here for more information on E-Verify.

    Create a job alert for this search

    Llm Engineer • Atlanta, GA, United States

    Related jobs
    • Promoted
    ITSM Problem Manager

    ITSM Problem Manager

    NEXTGEN HealthcareAtlanta, GA, United States
    Full-time
    The ITSM Problem Manager is a strategic and hands-on role responsible for driving root cause analysis, problem elimination, and long-term solutions to recurring issues impacting NextGen Healthcare....Show moreLast updated: 7 days ago
    • Promoted
    Sr. IT Manager, Core Banking

    Sr. IT Manager, Core Banking

    Varo BankAtlanta, GA, US
    Full-time
    Varo is an entirely new kind of bank.All digital, mission-driven, FDIC insured and designed for the way our customers live their lives. Manage and lead the internal core vendor team to ensure succes...Show moreLast updated: 25 days ago
    IT Applications Project Manager – Housing Systems - Hybrid

    IT Applications Project Manager – Housing Systems - Hybrid

    Sunrise SystemsAtlanta, Georgia, United States
    Full-time
    Quick Apply
    Job Title : IT Applications Project Manager Housing Systems.Duration : 08 months of Contract.IT Applications Project Manager Housing Systems needed to lead, coordinate, and support a housing soft...Show moreLast updated: 30+ days ago
    Agile coach

    Agile coach

    Sunrise SystemsAtlanta, Georgia, United States
    Full-time
    Quick Apply
    Duration : 06 months of contract.Supervises, guides, and / or instructs subordinate staff.Analyzes user requirements, procedures, and problems to automate business processes, upgrade or modify existin...Show moreLast updated: 30+ days ago
    • Promoted
    IT Manager, Cloud Foundations | Platforms

    IT Manager, Cloud Foundations | Platforms

    Atlanta StaffingAtlanta, GA, US
    Full-time
    How you'll help us Keep Climbing (overview & key responsibilities) At Delta Air Lines, connection is at the heart of everything we do and guides our every action. We strive to welcome and care for a...Show moreLast updated: 1 day ago
    • Promoted
    IT Engineer

    IT Engineer

    Oak Ridge Associated UniversitiesForest Park, GA, United States
    Full-time +1
    To provide desktop support / IT helpdesk in Atlanta and during deployments OCONUS for a minimum of 6 month periods of time. Perform installation, maintenance, trouble-shooting, and decommissioning of ...Show moreLast updated: 26 days ago
    • Promoted
    IT Manager, Collaboration

    IT Manager, Collaboration

    TIER4 GROUPAtlanta, GA, US
    Full-time
    Contract to Hire (6 months to FTE) | Onsite.One of our top digital banking clients has recently emerged as a spinoff from their parent company. Due to this, they need to hire an IT Manager, who will...Show moreLast updated: 30+ days ago
    • Promoted
    IT Risk Senior Manager

    IT Risk Senior Manager

    Atlanta StaffingAtlanta, GA, US
    Full-time
    As an IT Risk Senior Manager, you will grow and contribute to our clients' business needs by helping them understand their business risks and assist in addressing risk in both proactive and respons...Show moreLast updated: 5 days ago
    IT Manager 2 / Cybersecurity Audit Manager

    IT Manager 2 / Cybersecurity Audit Manager

    Sunrise SystemsAtlanta, Georgia, United States
    Full-time
    Quick Apply
    Job Title : IT Manager 2 / Cybersecurity Audit Manager.Duration : 12 Months of Contract.CLIENT is seeking a highly skilled and experienced Test Lead to coordinate and lead the testing efforts for the M...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    IT Helpdesk Manager

    IT Helpdesk Manager

    Tele SpecialistsBrookhaven, GA, United States
    Full-time
    This is a 100% in-office-based position.TeleSpecialists is transforming healthcare delivery as the nation's largest and fastest-growing digital healthcare leader. By providing expert neurological an...Show moreLast updated: 4 hours ago
    • Promoted
    IT Advisory & Consulting (ITAC) Manager

    IT Advisory & Consulting (ITAC) Manager

    PYA P CAtlanta, GA, US
    Full-time
    IT Advisory and Consulting (ITAC) Manager.This individual will be a member of the.PYA’s Consulting Department.For more information about PYA, please visit. Managing IT compliance and strategy ...Show moreLast updated: 30+ days ago
    • Promoted
    IT Infrastructure Manager

    IT Infrastructure Manager

    Logisteed America, INCForest Park, GA, US
    Full-time
    We are seeking a seasoned IT Infrastructure Manager with 10+ years of relevant experience to oversee and maintain the technology infrastructure across our organization, which includes up to 17 geog...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Manager, IT Risk & Internal Controls and Compliance

    Manager, IT Risk & Internal Controls and Compliance

    CRHAtlanta, GA, United States
    Full-time
    CRH's Americas Materials division is the leading integrated supplier of aggregates, asphalt, ready mixed concrete and paving and construction services in North America. Our operations span North Ame...Show moreLast updated: 4 hours ago
    • Promoted
    IT Project Manager

    IT Project Manager

    PMO Partners, LLCAlpharetta, GA, US
    Full-time
    The selected candidate must work in one of the indicated offices at a hybrid schedule of a minimum of three days per week in the office and could eventually be required in the office full time.The ...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Manager, IT Service Desk

    Manager, IT Service Desk

    Georgia System OperationsTucker, GA, United States
    Full-time
    Provides leadership and strategic direction for the Shared Services IT's Service Desk function, supporting GSOC, GTC, and OPC, ensuring customer satisfaction with the services provided.Responsible ...Show moreLast updated: 4 hours ago
    • Promoted
    IT Manager 2 / Cybersecurity Audit Manager

    IT Manager 2 / Cybersecurity Audit Manager

    4P Consulting Inc.Atlanta, GA, US
    Full-time
    HYBRID : ON-SITE TWO DAYS PER WEEK.POSITION AVAILABLE FOR EXTENSIONS BASED ON PROJECT AND BUDGET APPROVAL.The Georgia Department of Community Health (DCH) seeks a dedicated and skilled Cybersecurity...Show moreLast updated: 30+ days ago
    • Promoted
    IT Manager

    IT Manager

    Novatech Inc.Alpharetta, GA, US
    Full-time
    Novatech is The Managed Office Provider, offering a comprehensive portfolio of IT, Print, Cloud, and Security solutions for organizations across the country. We are growing nationwide and expanding ...Show moreLast updated: 7 days ago
    • Promoted
    • New!
    IT Risk Senior Manager

    IT Risk Senior Manager

    Grant ThorntonAtlanta, GA, United States
    Full-time
    As an IT Risk Senior Manager, you will get the opportunity to grow and contribute to our clients' business needs by helping them understand their business risks and assist in addressing risk in bot...Show moreLast updated: 4 hours ago