Rust Software Engineer – LLM Evaluation & Tooling - Elvis Eckardt Recruitment & Sales Solutions Limited - Los Angeles, CA
Elvis Eckardt Recruitment & Sales Solutions Limited
The Role: Senior Software Engineer – Rust (LLM Evaluation & Repository Validation)
Location: Permanent Remote, Africa-Based
Contract Type: Contractor (no medical/paid leave)
Duration: 3 months (extensions possible)
Start Date: Immediate (within 1 week)
Commitment: 20–40 hours/week with some overlap with Pacific Standard Time (PST)
Experience Required: 3–8 years overall, with 2+ years in Rust
About the Project
We are building LLM evaluation and training datasets to train large language models (LLMs) to work on realistic software engineering problems. A key approach in this project involves creating verifiable SWE tasks from public repository histories in a synthetic, human-in-the-loop process. The goal is to expand dataset coverage across programming languages, complexity levels, and problem domains.
This role blends hands-on software engineering with AI-focused research, giving you a chance to work at the intersection of open-source software and cutting-edge AI systems.
Responsibilities:
Analyse and triage GitHub issues across trending open-source libraries.Set up and configure repositories (including Dockerization and development environment setup).Evaluate unit test coverage and quality across projects.Run and modify codebases locally to assess LLM bug-fixing performance.Collaborate with researchers to design/select repositories and tasks challenging for LLMs.(Optional) Lead junior engineers collaborating on evaluation tasks.Why Join:
Work remotely on impactful AI + software engineering projects.Collaborate with researchers shaping the future of AI-assisted development.Opportunity to contribute to real-world open-source challenges while influencing LLM training and evaluation.Application Process: To apply, please submit your CV and a cover letter detailing your relevant experience and qualifications for the role. Applications will be reviewed on a rolling basis, so early submissions are encouraged.
Equal Opportunity Employer: We value diversity and