Research scientist, Fundamental Language Model

TikTok
Seattle
Full-time
We are sorry. The job offer you are looking for is no longer available.

About The Team

This position is responsible for researching and building the company's LLMs. The role involves exploring new applications and solutions for related technologies in areas such as search, recommendation, advertising, content creation, and customer service.

The goal is to meet the increasing demand for intelligent interactions from users and to significantly enhance their lifestyle and communication in the future.

The primary job responsibilities include : 1. Explore effective ways of evaluating the abilities of the model at various stages.

Open the black box of LLMs, understand the source of various abilities of LLMs, and provide guidance for the model iteration.

2. Synthesize large-scale, high-quality data through methods such as rewriting, augmentation, and generation, to improve the abilities of the pre-training model in various dimensions.

3. Explore effective training methods (such as active learning, curriculum learning, and effective training objectives for LLMs, and optimize the scaling laws.

1. Excellent coding ability, familiar with data structures, and fundamental algorithm skills, proficient in C / C++ or Python, winners of competitions such as ACM / ICPC, NOI / IOI, Top Coder, Kaggle, etc.

are preferred;2. Experience with deep learning, NLP, CV and familiarity with large-scale model training are preferred;3.

Candidates who have led influential projects or papers in NLP, deep learning are preferred;4. Excellent problem analysis and solving skills, able to deeply solve problems in large-scale model training and application;

5. Good communication and collaboration skills, able to explore new technologies with the team and promote technological progress.

21 days ago
Related jobs
ByteDance
Seattle, Washington

About the team:The Applied Machine Learning (AML) team is committed to the research and deployment of the next-generation of AI core technologies, such as large pretrained models and device-cloud collaboration learning, as well as their wide applications in practice, including but not limited to sea...

Microsoft
Redmond, Washington

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse f...

ByteDance
Seattle, Washington

With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas including natural language processing (NLP), computer vision (CV), and speech recognition and generation. We aim to lead global research and foster both technological and social progress. ...

TikTok
Seattle, Washington

We conduct cutting-edge research on areas like vision and language, large vision models, and generative foundation models. The team is a mix of experienced research scientists and engineers, aiming to advance the research boundaries in foundation models and apply our technologies to our rich applica...

Microsoft
Redmond, Washington

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse f...

Sony UK Technology Centre
Remote, Washington State
Remote

Our team mainly focuses on fundamental and applied research in privacy and security, with a focus on building vision foundation models in a trustworthy manner. The role of a research scientist is to conduct innovative research, develop methodologies, design and prototype solutions, and collaborate w...

Microsoft
Redmond, Washington

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse f...

TikTok
Seattle, Washington

The team is a mix of experienced research scientists and research engineers, aiming to push the research boundaries in multi-modality and applying our research results to improve the experience of TikTok users. Responsibilities- Conduct cutting-edge research and development in computer vision and na...

ByteDance
Seattle, Washington

The team builds heterogeneous ML training and inference systems based on GPU and advanced chip technology and advances the state-of-the-art of ML systems technology to accelerate models such as stable diffusion and language modeling. The team is reinventing the ML infra for large-scale language mode...

TikTok
Seattle, Washington

We conduct cutting-edge research on areas like vision and language, large vision models, and generative foundation models. The team is a mix of experienced research scientists and engineers, aiming to advance the research boundaries in foundation models and apply our technologies to our rich applica...