Development and Deployment of Custom LLMs on Amazon SageMaker by Indeed

Indeed, the world’s leading job search platform, has taken a significant step in incorporating artificial intelligence to enhance its services. With an audience of over 350 million unique monthly visitors in more than 60 countries, the company has begun using large language models (LLMs) to improve the connection between job seekers and job opportunities that best fit their profiles.

Recently, Indeed’s artificial intelligence team has partnered with Amazon SageMaker to address various infrastructure challenges and optimize their operations in artificial intelligence. This has significantly accelerated research and development within the company.

One of the main challenges for Indeed is handling around 320 terabytes of data generated daily. This information is crucial for connecting job descriptions and resumes, facilitating successful hires. LLMs offer a key opportunity to enhance this interaction by providing more accurate explanations of matches, as well as generating job descriptions and career guides.

The artificial intelligence team chose fine-tuning as their preferred method due to its ability to integrate Indeed’s specific knowledge and language domain resources. Using Amazon SageMaker, they have optimized this process, ensuring efficiency in fine-tuning handling and scaling, allowing the team to focus more on development and less on the technical aspect.

The implementation of Amazon SageMaker has brought several benefits to Indeed. The company has been able to optimize its computational resources, simplify the configuration of training jobs, and efficiently scale its models. Additionally, the introduction of Amazon SageMaker’s “inference components” has improved efficiency in deploying multiple models on a single instance, leading to significant cost and resource savings.

Since these advancements have been integrated, the language models created by the Core AI team have managed over 6.5 million production requests, demonstrating the robustness of the infrastructure to handle dynamic traffic. This strategy has not only improved Indeed’s efficiency but has also positioned the company at the forefront of technological innovation in the human resources sector.

The collaboration with Amazon SageMaker has not only been beneficial for Indeed but has also enabled AWS to enhance its generative artificial intelligence services, benefiting other clients. This joint effort highlights the transformative potential of integrating advanced artificial intelligence capabilities into business operations, driving both efficiency and innovation.

With these developments, Indeed has solidified its position as a leader in the use of artificial intelligence in the human resources industry, improving job matching processes and the overall experience for employers and candidates on its platform.

via: MiMub in Spanish

Scroll to Top
×