Python Jobs in New York, NY

Job Description

As a Senior Software Engineer focused on Agentic, LLM-powered applications, you will design, develop, and optimize intelligent systems and autonomous agents. You will work across the full stack of agent development—from prompt engineering and LLM integration to observability, orchestration, and cloud-native deployment. This role requires deep technical expertise with Python, modern LLM frameworks, and AWS services, along with hands-on experience building reliable, scalable AI-driven systems.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

Required Skills & Experience

Design, develop, and maintain LLM-powered applications and autonomous agents

· Build agentic workflows and orchestration layers using LangGraph or similar frameworks

· Implement and refine prompt engineering strategies for reliability, safety, and performance

· Integrate and evaluate modern LLM models across providers

· Develop agent observability using LangSmith, LangFuse, or equivalent tools

· Build and maintain MCP (Model Context Protocol) Server components

· Collaborate with cross-functional teams and participate in Agile ceremonies

· Develop backend services using AWS-native serverless and compute offerings

· Perform peer reviews and contribute to engineering standards and best practices

Nice to Have Skills & Experience

Bachelor’s degree in CS or related field

· 5+ years of professional software engineering experience

· Expertise in Python and relevant LLM/AI libraries

· Experience with LangGraph or similar agentic frameworks

· Deep knowledge of LLM model integration and tuning

· Hands-on experience with observability tools such as LangSmith or LangFuse

· Experience developing MCP Servers

· Strong knowledge of AWS services including Lambda, ECS, S3, DynamoDB, API Gateway

· Strong fundamentals in algorithms, distributed systems, and cloud-native design

· Experience building and consuming REST APIs and event-driven systems

· Excellent communication, collaboration, and problem-solving skills

· Self-directed, ability to multi-task, sharp analytical abilities, excellent communication skills

Desired Qualifications

· Experience with vector databases and embedding pipelines

· Experience with real-time or streaming platforms such as Kinesis or Kafka

· Familiarity with containerization technologies such as Docker

· Experience with reinforcement learning or agentic evaluation frameworks

· Results-oriented, high energy, self-motivated

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.