AI Engineer, Multimodal Models

Job Description

Job Description

We are looking for a passionate and autonomous Multimodal AI Engineer to contribute to our innovative projects in the field of the multimodal foundation models for LLM, image, and clinical data analysis. T he Multimodal AI Engineer will work with a dynamic team who is pushing the boundaries of AI machine learning in the healthcare domain and building real-world products for electronic health record (EHR) system. You will research best practices for data curation, preparation and training of our state-of-the-art foundation models and address some of the hardest problems in computer science.

Requirements

Location : This position is based in the San Diego metropolitan area; candidates must reside locally or be willing to relocate.

• Master's degree in Computer Science with a focus on LLM and image multimodal foundation models.
• Excellent programming skills in Python and C / C++.
• Proficiency in PyTorch framework and the common NLP libraries (NLTK, spaCy, scikit-learn, etc.)
• Experience with state-of-the-art deep learning architectures (ViT / SWIN transformer, GPT, CLIP, etc.).
• Experience with model compression and large-scale distributed model training (data-parallel and model-parallel) techniques.
• An outstanding track record of publications (NeurIPS, CVPR, ICML, AAAI, etc.) and contributions to the machine learning communities (kaggle, Hugging Face, etc.).
• Hands-on experience with parameter-efficient tuning (QLoRA) techniques and the LangChain framework is a plus.
• Experience with prompt engineering and fine-tuning Llama 2 or PaLM 2 with domain specific data is a plus.
• Experience with CUDA programming is a plus.
• Experience with imaging processing (opencv2, VTK, ITK, DCMTK, Albumentations) is a plus.
• Experience with vector databases (Chroma, Pinecone, Milvus, redis, etc.) is a plus.
• Experience with human-in-the-loop, Reinforcement Learning from Human Feedback (RLHF), and continuous online training is a plus.
• Knowledge for Stable Diffusion, OpenJourney, or DeepFloyd IF is a plus.

Benefits

The annual salary range for this position in the San Diego market is $185,000 to $215,000.

CliniComp's salary ranges are benchmarked and determined by role and level. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations and could be higher or lower based on a multitude of factors, including job-related skills, experience, location, and relevant education or training.

CCI complies with the Americans with Disabilities Act and considers reasonable accommodation measures that may be necessary for eligible applicants / employees to perform primary responsibilities. EEO / AA / M / F / Veteran / Disabled.