Food industries engineer Jobs

<h2 class="h5">Job description</h2> <div class="t-break" data-jb-field="description"> <span>Please submit your CV in English and indicate your level of English proficiency.<br> Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.<br> Participation is project-based, not permanent employment.<br>What this opportunity involves: We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<br> You'll create challenging tasks and evaluation criteria within realistic simulated environments: Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history Design tasks from intermediate states of these environments - craft the prompt, define what "solved" means, and ensure the task is solvable by an AI agent Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust What this is NOT: Not data labeling Not prompt engineering Not writing code from scratch - the agent writes most of the code; you guide and evaluate What we look for: 8+ years in software development Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis Experience writing tests (functional, integration) English proficiency - B2+ Why this is hard: Frontier models are already good at coding.<br> Creating a task that genuinely challenges the best models is non-trivial.<br> You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution.<br> Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<br> How it works Apply → Pass qualification(s) → Join a project → Complete tasks → Get paidEffort estimate Tasks for this project are estimated to take 30 hours to complete, depending on complexity.<br> This is an estimate and not a schedule requirement; you choose when and how to work.<br> Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<br> Compensation: Up to $150/hr equivalent , depending on level and pace.<br> Tasks are estimated at ~30 hours each; you set your own schedule.<br></span> </div>

<p><h4>Description</h4> <p>Syarah is on a mission to change how people buy their cars in Saudi and the Middle East. We offer buyers an end-to-end digital car buying experience where they can buy their next car from the comfort of their living rooms. Under the hood, we build systems to manage sourcing of cars, inspection, photography, merchandising, reconditioning, financing, insurance, shipping and many more. Our goal is to turn car buying into an experience of delight, comfort and peace of mind.</p> <p>We are on the lookout for ambitious, competitive, growth-minded professionals to help us continue to harness technology to delight our customers and achieve our ambitious growth objectives in the auto sector.</p> <p>All Syarah employees are expected to work in accordance with Syarah core values: Tolerance, Transparency, Respect, Integrity and Positivity.</p> <h4>Responsibilities:</h4> <ul> <li>Working closely with engineering, product and other business teams to communicate problem impacts and to understand business requirements.</li> <li>Strong knowledge of software testing principles and techniques, verification and validation techniques, and defect management.</li> <li>Defining the scope of testing within the context of each release/delivery.</li> <li>Identifies and analyzes issues, bugs, defects, and other problems, particularly when problems recur in multiple products; recommends and facilitates solutions to these issues.</li> <li>Maintain and run automation scripts for new functionality and regression testing.</li> <li>Write and implement automation scripts for API, Mobile, and Web.</li> </ul> <h4>Requirements</h4> <ul> <li>Good knowledge of software QA methodologies, tools and processes.</li> <li>Identify, troubleshoot, and document issues thoroughly during bugs tracking.</li> <li>Excellent analytical, logical and problem-solving skills.</li> <li>Conduct all types of testing [Smoke Test, Ad-hoc test, System test, Integration test, etc.].</li> <li>Good experience in APIs testing using tools such as Postman, Soap UI, Katalon.</li> <li>Familiar with SQL queries.</li> <li>Good experience in test frameworks such as Selenium or Appium.</li> <li>Good experience developing automated UI and API tests.</li> <li>Experience with web testing elements such as HTML, CSS, XPath, etc.</li> <li>Ability to work in a fast-paced environment where team collaboration and personal pride in quality of work are highly valued.</li> </ul> <h4>Education and Experience:</h4> <ul> <li>BS/MS degree in Computer Science, Engineering or a related subject.</li> <li>3+ years of progressive professional experience in Quality Control and Testing.</li> <li>2+ years of experience writing automated tests, including integration, API, Mobile, Web and Performance.</li> </ul></p><p></p>

<p><h4>Description</h4> <p>Syarah is on a mission to change how people buy their cars in Saudi and the Middle East. We offer buyers an end-to-end digital car buying experience where they can buy their next car from the comfort of their living rooms. Under the hood, we build systems to manage sourcing of cars, inspection, photography, merchandising, reconditioning, financing, insurance, shipping and many more. Our goal is to turn car buying into an experience of delight, comfort and peace of mind.</p> <p>We are on the lookout for ambitious, competitive, growth-minded professionals to help us continue to harness technology to delight our customers and achieve our ambitious growth objectives in the auto sector.</p> <p>All Syarah employees are expected to work in accordance with Syarah core values: Tolerance, Transparency, Respect, Integrity and Positivity.</p> <h4>Responsibilities:</h4> <ul> <li>Working closely with engineering, product and other business teams to communicate problem impacts and to understand business requirements.</li> <li>Strong knowledge of software testing principles and techniques, verification and validation techniques, and defect management.</li> <li>Defining the scope of testing within the context of each release/delivery.</li> <li>Identifies and analyzes issues, bugs, defects, and other problems, particularly when problems recur in multiple products; recommends and facilitates solutions to these issues.</li> <li>Maintain and run automation scripts for new functionality and regression testing.</li> <li>Write and implement automation scripts for API, Mobile, and Web.</li> </ul> <h4>Requirements</h4> <ul> <li>Good knowledge of software QA methodologies, tools and processes.</li> <li>Identify, troubleshoot, and document issues thoroughly during bugs tracking.</li> <li>Excellent analytical, logical and problem-solving skills.</li> <li>Conduct all types of testing [Smoke Test, Ad-hoc test, System test, Integration test, etc.].</li> <li>Good experience in APIs testing using tools such as Postman, Soap UI, Katalon.</li> <li>Familiar with SQL queries.</li> <li>Good experience in test frameworks such as Selenium or Appium.</li> <li>Good experience developing automated UI and API tests.</li> <li>Experience with web testing elements such as HTML, CSS, XPath, etc.</li> <li>Ability to work in a fast-paced environment where team collaboration and personal pride in quality of work are highly valued.</li> </ul> <h4>Education and Experience:</h4> <ul> <li>BS/MS degree in Computer Science, Engineering or a related subject.</li> <li>3+ years of progressive professional experience in Quality Control and Testing.</li> <li>2+ years of experience writing automated tests, including integration, API, Mobile, Web and Performance.</li> </ul></p><p></p>

<p><h4>Please submit your CV in English and indicate your level of English proficiency.<\/h4>\n<p>Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.<\/p>\n<h4>What this opportunity involves:<\/h4>\n<p>We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<\/p>\n<p>You'll create challenging tasks and evaluation criteria within realistic simulated environments:<\/p>\n<ul>\n <li>Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history<\/li>\n <li>Design tasks from intermediate states of these environments - craft the prompt, define what \"solved\" means, and ensure the task is solvable by an AI agent<\/li>\n <li>Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient<\/li>\n <li>Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust<\/li>\n<\/ul>\n<h4>What this is NOT:<\/h4>\n<ul>\n <li>Not data labeling<\/li>\n <li>Not prompt engineering<\/li>\n <li>Not writing code from scratch - the agent writes most of the code; you guide and evaluate<\/li>\n<\/ul>\n<h4>What we look for:<\/h4>\n<ul>\n <li>8+ years in software development<\/li>\n <li>Core stack: Python (FastAPI), JavaScript\/TypeScript (React), Docker, Postgres, Kafka, Redis<\/li>\n <li>Experience writing tests (functional, integration)<\/li>\n <li>English proficiency - B2+<\/li>\n<\/ul>\n<h4>Why this is hard:<\/h4>\n<p>Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<\/p>\n<h4>How it works<\/h4>\n<p>Apply ? Pass qualification(s) ? Join a project ? Complete tasks ? Get paid<\/p>\n<h4>Effort estimate<\/h4>\n<p>Tasks for this project are estimated to take 30 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<\/p><\/p><p><\/p>

<p><h4>Description</h4> <p>Are you ready to take the lead in driving technical excellence? Optimiza is looking for a dynamic and engaging technical team leader to inspire and guide our talented team of engineers and developers. As the technical team leader, you will play a pivotal role in shaping project success, fostering collaboration, and delivering cutting-edge solutions that exceed client expectations.</p> <h4>Key responsibilities:</h4> <ul> <li>Lead, mentor, and motivate a team of technical professionals to achieve project goals with a passion for quality and innovation.</li> <li>Plan, coordinate, and oversee technical project deliverables while ensuring timely and successful completion.</li> <li>Collaborate closely with stakeholders, project managers, and cross-functional teams to align technical efforts with business objectives.</li> <li>Drive continuous improvement by encouraging knowledge sharing, adopting best practices, and promoting a culture of learning.</li> <li>Identify risks and challenges early and implement effective solutions to keep projects on track.</li> <li>Communicate complex technical concepts clearly and engagingly to both technical team members and non-technical stakeholders.</li> <li>Stay ahead of the curve by keeping up with the latest technology trends and integrating relevant advancements into team practices.</li> </ul> <h4>Requirements</h4> <ul> <li>Bachelor's degree in computer science, engineering, or related field.</li> <li>Years of experience: 6+ years</li> <li>Technical knowledge: system administration, good knowledge in Windows, Linux, and networking (infrastructure support background)</li> <li>Good troubleshooting skills including networking and system administration.</li> <li>Customer support job experience.</li> </ul> <h4>Preferred skills</h4> <ul> <li>API traffic flow knowledge</li> <li>Database</li> <li>Active Directory and group policy</li> </ul> <h4>Benefits</h4> <ul> <li>Annual bonus</li> <li>Class A health insurance</li> <li>Training and development</li> <li>Performance bonus</li> </ul></p><p></p>

<p><h4>Description</h4> <p>Do you want to love what you do at work? Do you want to make a difference, an impact, transform people's lives? Do you want to work with a team that believes in disrupting the normal, boring, and average?</p> <p>If yes, then this is the job you're looking for. UXBERT Labs is one of the leading digital and user experience design agencies in the GCC, working with top regional and international brands such as STC, Amazon, Gucci, and more. As part of the Supertech Group—which also includes Hala Yalla, Saudi's number one private event ticketing and experience booking platform, and Kafu Games, the largest esports tournament platform in MENA—we are continuously expanding our innovation footprint.</p> <h4>Responsibilities:</h4> <ul> <li><strong>CI/CD & Automation:</strong> Design, implement, and manage robust CI/CD pipelines for Node.js and React applications using GitHub Actions and Bitbucket Pipelines across development, staging, and production environments.</li> <li><strong>Infrastructure as Code (IaC):</strong> Maintain and scale cloud infrastructure using Terraform or CloudFormation.</li> <li><strong>Containerization & Orchestration:</strong> Containerize applications using Docker and orchestrate using Kubernetes (optional). Excellent experience working on Kubernetes clusters such as GKE or AKS is a plus.</li> <li><strong>Monitoring & Observability:</strong> Monitor system health, security, and performance. Solid experience with New Relic, Datadog, and APM, including setting up APM cadence, alerts, and rules and policies for support and disaster management.</li> <li><strong>Cloud & Networking:</strong> Excellent experience with cloud-based VPC and networking within load balancing and orchestration.</li> <li><strong>Future-Proofing:</strong> Ability to learn fast and understand emerging technologies such as large language models, complex CI/CD setups in the future, including AI machine learning and AI coding.</li> </ul> <h4>Requirements</h4> <ul> <li><strong>Development & Infrastructure:</strong> Strong skills in quickly setting up servers in Node.js, whitelisting IPs, and providing Docker and secure environments for developers, production, and testers.</li> <li><strong>Coding Background:</strong> Seven or more years of DevOps experience across cloud platforms. An engineering background in PHP or a strong programming background is beneficial; solid JavaScript or Python skills are a must.</li> <li><strong>Cloud & Caching Expertise:</strong> Proficiency with both GCP and AWS is required. Must have solid experience with CDNs, CloudFlare, and configuration of complex caching in Redis and more. GCP certification is highly advantageous as Saudi Arabia prefers to work with GCP.</li> <li><strong>Database & Scaling:</strong> Understanding of database setup, high scaling, and high traffic sites both with and without CloudFlare. Experience with complex database optimization, data flow diagrams, and migration.</li> <li><strong>Modern Workflows:</strong> Experience with Vercel for front-end deployment workflows.</li> <li><strong>Environment Familiarity:</strong> Familiarity with Node.js environments, Linux, and monitoring tools.</li> <li><strong>AI Integration:</strong> Engineers must incorporate AI-assisted coding tools such as Claude, Grok, or ChatGPT as part of their daily work.</li> </ul> <h4>Benefits</h4> <ul> <li>Fully remote role (must align with Saudi Arabia working hours).</li> <li>Opportunity to work on high-impact Saudi government and enterprise projects.</li> <li>Collaborative culture with strong design and engineering teams.</li> <li>Competitive salary.</li> <li>Professional development budget for certifications and training.</li> </ul></p><p></p>

<h2 class="h5">Job description</h2> <div class="t-break" data-jb-field="description"> <span>Please submit your CV in English and indicate your level of English proficiency.<br> Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.<br> Participation is project-based, not permanent employment.<br>What this opportunity involves: We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<br> You'll create challenging tasks and evaluation criteria within realistic simulated environments: Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history Design tasks from intermediate states of these environments - craft the prompt, define what "solved" means, and ensure the task is solvable by an AI agent Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust What this is NOT: Not data labeling Not prompt engineering Not writing code from scratch - the agent writes most of the code; you guide and evaluate What we look for: 8+ years in software development Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis Experience writing tests (functional, integration) English proficiency - B2+ Why this is hard: Frontier models are already good at coding.<br> Creating a task that genuinely challenges the best models is non-trivial.<br> You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution.<br> Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<br> How it works Apply → Pass qualification(s) → Join a project → Complete tasks → Get paidEffort estimate Tasks for this project are estimated to take 30 hours to complete, depending on complexity.<br> This is an estimate and not a schedule requirement; you choose when and how to work.<br> Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<br> Compensation: Up to $150/hr equivalent , depending on level and pace.<br> Tasks are estimated at ~30 hours each; you set your own schedule.<br></span> </div>

<p><h4>Description<\/h4>\n<p>Please submit your CV in English and indicate your level of English proficiency.<\/p>\n<p>Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.<\/p>\n<h4>What this opportunity involves<\/h4>\n<p>We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<\/p>\n<p>You'll create challenging tasks and evaluation criteria within realistic simulated environments:<\/p>\n<ul>\n<li>Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history<\/li>\n<li>Design tasks from intermediate states of these environments - craft the prompt, define what \"solved\" means, and ensure the task is solvable by an AI agent<\/li>\n<li>Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient<\/li>\n<li>Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust<\/li>\n<\/ul>\n<h4>What this is not<\/h4>\n<ul>\n<li>Not data labeling<\/li>\n<li>Not prompt engineering<\/li>\n<li>Not writing code from scratch - the agent writes most of the code; you guide and evaluate<\/li>\n<\/ul>\n<h4>What we look for<\/h4>\n<ul>\n<li>5+ years in software development<\/li>\n<li>Core stack: Python (FastAPI), JavaScript\/TypeScript (React), Docker, Postgres, Kafka, Redis<\/li>\n<li>Experience writing tests (functional, integration)<\/li>\n<li>English proficiency - B2+<\/li>\n<\/ul>\n<h4>Why this is hard<\/h4>\n<p>Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<\/p>\n<h4>How it works<\/h4>\n<p>Apply ? Pass qualification(s) ? Join a project ? Complete tasks ? Get paid<\/p>\n<h4>Effort estimate<\/h4>\n<p>Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<\/p>\n<h4>Compensation<\/h4>\n<p>Up to $50\/hr equivalent, depending on level and pace. Tasks are estimated at ~20 hours each; you set your own schedule.<\/p><\/p><p><\/p>

<p><h4>Description<\/h4>\n<p>Please submit your CV in English and indicate your level of English proficiency.<\/p>\n<p>Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.<\/p>\n<h4>What this opportunity involves<\/h4>\n<p>We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<\/p>\n<p>You'll create challenging tasks and evaluation criteria within realistic simulated environments:<\/p>\n<ul>\n <li>Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history<\/li>\n <li>Design tasks from intermediate states of these environments - craft the prompt, define what \"solved\" means, and ensure the task is solvable by an AI agent<\/li>\n <li>Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient<\/li>\n <li>Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust<\/li>\n<\/ul>\n<h4>What this is not<\/h4>\n<ul>\n <li>Not data labeling<\/li>\n <li>Not prompt engineering<\/li>\n <li>Not writing code from scratch - the agent writes most of the code; you guide and evaluate<\/li>\n<\/ul>\n<h4>What we look for<\/h4>\n<ul>\n <li>5+ years in software development<\/li>\n <li>Core stack: Python (FastAPI), JavaScript\/TypeScript (React), Docker, Postgres, Kafka, Redis<\/li>\n <li>Experience writing tests (functional, integration)<\/li>\n <li>English proficiency - B2+<\/li>\n<\/ul>\n<h4>Why this is hard<\/h4>\n<p>Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<\/p>\n<h4>How it works<\/h4>\n<p>Apply? Pass qualification(s)? Join a project? Complete tasks? Get paid<\/p>\n<h4>Effort estimate<\/h4>\n<p>Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<\/p>\n<h4>Compensation<\/h4>\n<p>Up to $50\/hr equivalent, depending on level and pace. Tasks are estimated at approximately 20 hours each; you set your own schedule.<\/p><\/p><p><\/p>

<p><h4>Description<\/h4>\n<p>Please submit your CV in English and indicate your level of English proficiency.<\/p>\n<p>Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.<\/p>\n<h4>What this opportunity involves<\/h4>\n<p>We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<\/p>\n<p>You'll create challenging tasks and evaluation criteria within realistic simulated environments:<\/p>\n<ul>\n <li>Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history<\/li>\n <li>Design tasks from intermediate states of these environments - craft the prompt, define what \"solved\" means, and ensure the task is solvable by an AI agent<\/li>\n <li>Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient<\/li>\n <li>Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust<\/li>\n<\/ul>\n<h4>What this is not<\/h4>\n<ul>\n <li>Not data labeling<\/li>\n <li>Not prompt engineering<\/li>\n <li>Not writing code from scratch - the agent writes most of the code; you guide and evaluate<\/li>\n<\/ul>\n<h4>What we look for<\/h4>\n<ul>\n <li>5+ years in software development<\/li>\n <li>Core stack: Python (FastAPI), JavaScript\/TypeScript (React), Docker, Postgres, Kafka, Redis<\/li>\n <li>Experience writing tests (functional, integration)<\/li>\n <li>English proficiency - B2+<\/li>\n<\/ul>\n<h4>Why this is hard<\/h4>\n<p>Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<\/p>\n<h4>How it works<\/h4>\n<p>Apply? Pass qualification(s)? Join a project? Complete tasks? Get paid<\/p>\n<h4>Effort estimate<\/h4>\n<p>Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<\/p>\n<h4>Compensation<\/h4>\n<p>Up to $50\/hr equivalent, depending on level and pace. Tasks are estimated at approximately 20 hours each; you set your own schedule.<\/p><\/p><p><\/p>

<p><h4>Description<\/h4>\n<p>Please submit your CV in English and indicate your level of English proficiency.<\/p>\n<p>Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.<\/p>\n<h4>What this opportunity involves<\/h4>\n<p>We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<\/p>\n<p>You'll create challenging tasks and evaluation criteria within realistic simulated environments:<\/p>\n<ul>\n<li>Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history<\/li>\n<li>Design tasks from intermediate states of these environments - craft the prompt, define what \"solved\" means, and ensure the task is solvable by an AI agent<\/li>\n<li>Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient<\/li>\n<li>Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust<\/li>\n<\/ul>\n<h4>What this is not<\/h4>\n<ul>\n<li>Not data labeling<\/li>\n<li>Not prompt engineering<\/li>\n<li>Not writing code from scratch - the agent writes most of the code; you guide and evaluate<\/li>\n<\/ul>\n<h4>What we look for<\/h4>\n<ul>\n<li>5+ years in software development<\/li>\n<li>Core stack: Python (FastAPI), JavaScript\/TypeScript (React), Docker, Postgres, Kafka, Redis<\/li>\n<li>Experience writing tests (functional, integration)<\/li>\n<li>English proficiency - B2+<\/li>\n<\/ul>\n<h4>Why this is hard<\/h4>\n<p>Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<\/p>\n<h4>How it works<\/h4>\n<p>Apply ? Pass qualification(s) ? Join a project ? Complete tasks ? Get paid<\/p>\n<h4>Effort estimate<\/h4>\n<p>Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<\/p>\n<h4>Compensation<\/h4>\n<p>Up to $50\/hr equivalent, depending on level and pace. Tasks are estimated at ~20 hours each; you set your own schedule.<\/p><\/p><p><\/p>

<p><h4>Description<\/h4>\n<p>Please submit your CV in English and indicate your level of English proficiency.<\/p>\n<p>Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.<\/p>\n<h4>What this opportunity involves<\/h4>\n<p>We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<\/p>\n<p>You'll create challenging tasks and evaluation criteria within realistic simulated environments:<\/p>\n<ul>\n<li>Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history<\/li>\n<li>Design tasks from intermediate states of these environments - craft the prompt, define what \"solved\" means, and ensure the task is solvable by an AI agent<\/li>\n<li>Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient<\/li>\n<li>Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust<\/li>\n<\/ul>\n<h4>What this is not<\/h4>\n<ul>\n<li>Not data labeling<\/li>\n<li>Not prompt engineering<\/li>\n<li>Not writing code from scratch - the agent writes most of the code; you guide and evaluate<\/li>\n<\/ul>\n<h4>What we look for<\/h4>\n<ul>\n<li>5+ years in software development<\/li>\n<li>Core stack: Python (FastAPI), JavaScript\/TypeScript (React), Docker, Postgres, Kafka, Redis<\/li>\n<li>Experience writing tests (functional, integration)<\/li>\n<li>English proficiency - B2+<\/li>\n<\/ul>\n<h4>Why this is hard<\/h4>\n<p>Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<\/p>\n<h4>How it works<\/h4>\n<p>Apply ? Pass qualification(s) ? Join a project ? Complete tasks ? Get paid<\/p>\n<h4>Effort estimate<\/h4>\n<p>Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<\/p>\n<h4>Compensation<\/h4>\n<p>Up to $50\/hr equivalent, depending on level and pace. Tasks are estimated at ~20 hours each; you set your own schedule.<\/p><\/p><p><\/p>

<p><h4>Description<\/h4>\n<p>Please submit your CV in English and indicate your level of English proficiency.<\/p>\n<p>Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.<\/p>\n<h4>What this opportunity involves<\/h4>\n<p>We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<\/p>\n<p>You'll create challenging tasks and evaluation criteria within realistic simulated environments:<\/p>\n<ul>\n<li>Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history<\/li>\n<li>Design tasks from intermediate states of these environments - craft the prompt, define what \"solved\" means, and ensure the task is solvable by an AI agent<\/li>\n<li>Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient<\/li>\n<li>Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust<\/li>\n<\/ul>\n<h4>What this is not<\/h4>\n<ul>\n<li>Not data labeling<\/li>\n<li>Not prompt engineering<\/li>\n<li>Not writing code from scratch - the agent writes most of the code; you guide and evaluate<\/li>\n<\/ul>\n<h4>What we look for<\/h4>\n<ul>\n<li>5+ years in software development<\/li>\n<li>Core stack: Python (FastAPI), JavaScript\/TypeScript (React), Docker, Postgres, Kafka, Redis<\/li>\n<li>Experience writing tests (functional, integration)<\/li>\n<li>English proficiency - B2+<\/li>\n<\/ul>\n<h4>Why this is hard<\/h4>\n<p>Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<\/p>\n<h4>How it works<\/h4>\n<p>Apply ? Pass qualification(s) ? Join a project ? Complete tasks ? Get paid<\/p>\n<h4>Effort estimate<\/h4>\n<p>Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<\/p>\n<h4>Compensation<\/h4>\n<p>Up to $50\/hr equivalent, depending on level and pace. Tasks are estimated at approximately 20 hours each; you set your own schedule.<\/p><\/p><p><\/p>

<p><h4>Description</h4> <h4>Key responsibilities</h4> <h4>Technical presales support</h4> <p>Collaborate with sales teams to understand customer business and technical requirements in KSA and UAE.<br> Design and propose suitable technical solutions aligned with customer needs.<br> Prepare technical proposals, solution architectures, and statements of work.<br> Conduct product presentations, demonstrations, and proof-of-concept (POC) sessions.<br> Respond to RFPs, RFIs, and RFQs with technical and functional inputs.<br> Assist in effort estimation, BOM preparation, and solution sizing.</p> <h4>Customer engagement</h4> <p>Participate in customer meetings, workshops, and discovery sessions.<br> Explain technical concepts clearly to both technical and non-technical stakeholders.<br> Build trusted relationships with customers, partners, and internal teams.<br> Address customer technical concerns and provide recommendations.</p> <h4>Solution design & documentation</h4> <p>Prepare high-level and low-level solution designs when required.<br> Create architecture diagrams, implementation approaches, and integration workflows.<br> Ensure proposed solutions follow best practices, scalability, security, and compliance standards.</p> <h4>Collaboration</h4> <p>Coordinate with engineering, delivery, product, and support teams.<br> Work closely with project managers and solution architects during transition to delivery.<br> Support continuous improvement of presales assets, templates, and demo environments.</p> <h4>Market & product knowledge</h4> <p>Stay updated on industry trends, competitor solutions, and emerging technologies.<br> Maintain strong understanding of company products, services, and capabilities.</p> <h4>Required qualifications</h4> <p>Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field.<br> 3–6 years of experience in presales, solution engineering, systems engineering, or technical consulting.<br> Experience in preparing technical proposals and responding to RFPs.<br> Strong understanding of enterprise IT solutions, cloud technologies, integrations, and software architectures.<br> Excellent communication and presentation skills.<br> Ability to work in a fast-paced, customer-facing environment.</p> <h4>Preferred skills</h4> <p>Experience with cloud platforms such as Azure, AWS, or Google Cloud.<br> Knowledge of APIs, integrations, databases, and enterprise applications.<br> Familiarity with cybersecurity, infrastructure, data, or AI solutions is a plus.<br> Experience with diagramming and documentation tools (Visio, Draw.io, etc.).<br> Relevant technical certifications are advantageous.</p> <h4>Soft skills</h4> <p>Strong analytical and problem-solving abilities.<br> Customer-oriented mindset.<br> Strong teamwork and collaboration skills.<br> Ability to manage multiple opportunities simultaneously.<br> Good negotiation and stakeholder management skills.</p> <h4>KPIs / success metrics</h4> <ul> <li>Quality and timeliness of technical proposals.</li> <li>Win rate contribution.</li> <li>Customer satisfaction during presales engagements.</li> <li>Accuracy of solution sizing and estimations.</li> <li>Number of successful demos and POCs delivered.</li> </ul></p><p></p>

<p><h4>Description</h4> <h4>Key responsibilities</h4> <h4>Technical presales support</h4> <p>Collaborate with sales teams to understand customer business and technical requirements in KSA and UAE.<br> Design and propose suitable technical solutions aligned with customer needs.<br> Prepare technical proposals, solution architectures, and statements of work.<br> Conduct product presentations, demonstrations, and proof-of-concept (POC) sessions.<br> Respond to RFPs, RFIs, and RFQs with technical and functional inputs.<br> Assist in effort estimation, BOM preparation, and solution sizing.</p> <h4>Customer engagement</h4> <p>Participate in customer meetings, workshops, and discovery sessions.<br> Explain technical concepts clearly to both technical and non-technical stakeholders.<br> Build trusted relationships with customers, partners, and internal teams.<br> Address customer technical concerns and provide recommendations.</p> <h4>Solution design & documentation</h4> <p>Prepare high-level and low-level solution designs when required.<br> Create architecture diagrams, implementation approaches, and integration workflows.<br> Ensure proposed solutions follow best practices, scalability, security, and compliance standards.</p> <h4>Collaboration</h4> <p>Coordinate with engineering, delivery, product, and support teams.<br> Work closely with project managers and solution architects during transition to delivery.<br> Support continuous improvement of presales assets, templates, and demo environments.</p> <h4>Market & product knowledge</h4> <p>Stay updated on industry trends, competitor solutions, and emerging technologies.<br> Maintain strong understanding of company products, services, and capabilities.</p> <h4>Required qualifications</h4> <p>Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field.<br> 3–6 years of experience in presales, solution engineering, systems engineering, or technical consulting.<br> Experience in preparing technical proposals and responding to RFPs.<br> Strong understanding of enterprise IT solutions, cloud technologies, integrations, and software architectures.<br> Excellent communication and presentation skills.<br> Ability to work in a fast-paced, customer-facing environment.</p> <h4>Preferred skills</h4> <p>Experience with cloud platforms such as Azure, AWS, or Google Cloud.<br> Knowledge of APIs, integrations, databases, and enterprise applications.<br> Familiarity with cybersecurity, infrastructure, data, or AI solutions is a plus.<br> Experience with diagramming and documentation tools (Visio, Draw.io, etc.).<br> Relevant technical certifications are advantageous.</p> <h4>Soft skills</h4> <p>Strong analytical and problem-solving abilities.<br> Customer-oriented mindset.<br> Strong teamwork and collaboration skills.<br> Ability to manage multiple opportunities simultaneously.<br> Good negotiation and stakeholder management skills.</p> <h4>KPIs / success metrics</h4> <ul> <li>Quality and timeliness of technical proposals.</li> <li>Win rate contribution.</li> <li>Customer satisfaction during presales engagements.</li> <li>Accuracy of solution sizing and estimations.</li> <li>Number of successful demos and POCs delivered.</li> </ul></p><p></p>

<p><h4>Description<\/h4>\n<p>Please submit your CV in English and indicate your level of English proficiency.<\/p>\n<p>Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.<\/p>\n<h4>What this opportunity involves<\/h4>\n<p>We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<\/p>\n<p>You'll create challenging tasks and evaluation criteria within realistic simulated environments:<\/p>\n<ul>\n <li>Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history<\/li>\n <li>Design tasks from intermediate states of these environments - craft the prompt, define what \"solved\" means, and ensure the task is solvable by an AI agent<\/li>\n <li>Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient<\/li>\n <li>Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust<\/li>\n<\/ul>\n<h4>What this is not<\/h4>\n<ul>\n <li>Not data labeling<\/li>\n <li>Not prompt engineering<\/li>\n <li>Not writing code from scratch - the agent writes most of the code; you guide and evaluate<\/li>\n<\/ul>\n<h4>What we look for<\/h4>\n<ul>\n <li>5+ years in software development<\/li>\n <li>Core stack: Python (FastAPI), JavaScript\/TypeScript (React), Docker, Postgres, Kafka, Redis<\/li>\n <li>Experience writing tests (functional, integration)<\/li>\n <li>English proficiency - B2+<\/li>\n<\/ul>\n<h4>Why this is hard<\/h4>\n<p>Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<\/p>\n<h4>How it works<\/h4>\n<p>Apply \u2192 Pass qualification(s) \u2192 Join a project \u2192 Complete tasks \u2192 Get paid<\/p>\n<h4>Effort estimate<\/h4>\n<p>Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<\/p>\n<h4>Compensation<\/h4>\n<p>Up to $50\/hr equivalent, depending on level and pace. Tasks are estimated at approximately 20 hours each; you set your own schedule.<\/p><\/p><p><\/p>

<p><h4>Description<\/h4>\n<p>Please submit your CV in English and indicate your level of English proficiency.<\/p>\n<p>Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.<\/p>\n<h4>What this opportunity involves<\/h4>\n<p>We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<\/p>\n<p>You'll create challenging tasks and evaluation criteria within realistic simulated environments:<\/p>\n<ul>\n <li>Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history<\/li>\n <li>Design tasks from intermediate states of these environments - craft the prompt, define what \"solved\" means, and ensure the task is solvable by an AI agent<\/li>\n <li>Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient<\/li>\n <li>Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust<\/li>\n<\/ul>\n<h4>What this is not<\/h4>\n<ul>\n <li>Not data labeling<\/li>\n <li>Not prompt engineering<\/li>\n <li>Not writing code from scratch - the agent writes most of the code; you guide and evaluate<\/li>\n<\/ul>\n<h4>What we look for<\/h4>\n<ul>\n <li>5+ years in software development<\/li>\n <li>Core stack: Python (FastAPI), JavaScript\/TypeScript (React), Docker, Postgres, Kafka, Redis<\/li>\n <li>Experience writing tests (functional, integration)<\/li>\n <li>English proficiency - B2+<\/li>\n<\/ul>\n<h4>Why this is hard<\/h4>\n<p>Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<\/p>\n<h4>How it works<\/h4>\n<p>Apply \u2192 Pass qualification(s) \u2192 Join a project \u2192 Complete tasks \u2192 Get paid<\/p>\n<h4>Effort estimate<\/h4>\n<p>Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<\/p>\n<h4>Compensation<\/h4>\n<p>Up to $50\/hr equivalent, depending on level and pace. Tasks are estimated at approximately 20 hours each; you set your own schedule.<\/p><\/p><p><\/p>

<p><h4>Job purpose</h4> <p>To support the design, installation, operation, and improvement of electrical systems by providing technical assistance, resolving day-to-day engineering issues, and coordinating with relevant teams to ensure safe and reliable performance in line with project and operational requirements.</p> <h4>Key accountability areas</h4> <strong>Electrical engineering activities</strong><br> <li>Prepare and review electrical drawings and technical submittals in accordance with project specifications and standards.</li> <li>Provide technical support during installation, testing, and commissioning activities.</li> <li>Troubleshoot electrical faults and coordinate with maintenance or project teams for resolution.</li> <li>Implement approved design and engineering changes.</li> <strong>Technical coordination and documentation</strong><br> <li>Prepare technical reports, calculations, and engineering documentation as required.</li> <li>Provide technical clarifications to internal teams, contractors, and suppliers.</li> <li>Support material submittal reviews and technical evaluations.</li> <li>Maintain updated engineering records and as-built drawings.</li> <strong>Quality and compliance</strong><br> <li>Ensure electrical activities are performed in line with applicable standards and approved procedures.</li> <li>Coordinate with the quality team to address non-conformities and implement corrective actions.</li> <li>Witness testing activities and verify proper documentation of results.</li> <strong>HSE and operational support</strong><br> <li>Follow HSE policies and promote safe working practices during all electrical activities.</li> <li>Identify and report potential risks and support corrective actions.</li> <li>Coordinate with concerned functions to ensure smooth execution of work.</li> <h4>Role accountability</h4> <strong>HR proficiency</strong><br> <p>Ability to obtain updated soft and technical skills related to the job.</p> <strong>Delivery</strong><br> <li>Perform the planned activities to meet the operational and development targets as per delivery schedules.</li> <li>Utilize resources effectively to achieve objectives within efficient cost and time.</li> <li>Provide a periodic report formatted by detailing the deviation and execution of planned tasks.</li> <strong>Problem-solving</strong><br> <p>Solve any related problems that arise and escalate any complex operational issues.</p> <strong>Quality</strong><br> <p>Ensure quality requirements to develop effective quality control and processes including specifications for products, processes, or related activities.</p> <strong>Business process improvements</strong><br> <p>Coordinate well-defined written systems, policies, procedures, and seek automation opportunities as much as possible.</p> <strong>Compliance</strong><br> <p>Comply with related policies, procedures, and work instructions.</p> <strong>Health, safety, and environment</strong><br> <p>Ensure compliance with relevant safety, quality, and environmental management procedures and controls within defined area of work activity to guarantee safety, legislative compliance, and delivery of high-quality products and services.</p> <h4>Academic qualification</h4> <p>Bachelor degree in Electrical Engineering</p> <h4>Work experience</h4> <p>2 to 4 years</p> <h4>Technical / functional competencies</h4> <p>Safety<br> Design<br> Design tools<br> Engineering design<br> Design specifications</p></p><p></p>

<p><h4>Job purpose</h4> <p>To support the design, installation, operation, and improvement of electrical systems by providing technical assistance, resolving day-to-day engineering issues, and coordinating with relevant teams to ensure safe and reliable performance in line with project and operational requirements.</p> <h4>Key accountability areas</h4> <strong>Electrical engineering activities</strong><br> <li>Prepare and review electrical drawings and technical submittals in accordance with project specifications and standards.</li> <li>Provide technical support during installation, testing, and commissioning activities.</li> <li>Troubleshoot electrical faults and coordinate with maintenance or project teams for resolution.</li> <li>Implement approved design and engineering changes.</li> <strong>Technical coordination and documentation</strong><br> <li>Prepare technical reports, calculations, and engineering documentation as required.</li> <li>Provide technical clarifications to internal teams, contractors, and suppliers.</li> <li>Support material submittal reviews and technical evaluations.</li> <li>Maintain updated engineering records and as-built drawings.</li> <strong>Quality and compliance</strong><br> <li>Ensure electrical activities are performed in line with applicable standards and approved procedures.</li> <li>Coordinate with the quality team to address non-conformities and implement corrective actions.</li> <li>Witness testing activities and verify proper documentation of results.</li> <strong>HSE and operational support</strong><br> <li>Follow HSE policies and promote safe working practices during all electrical activities.</li> <li>Identify and report potential risks and support corrective actions.</li> <li>Coordinate with concerned functions to ensure smooth execution of work.</li> <h4>Role accountability</h4> <strong>HR proficiency</strong><br> <p>Ability to obtain updated soft and technical skills related to the job.</p> <strong>Delivery</strong><br> <li>Perform the planned activities to meet the operational and development targets as per delivery schedules.</li> <li>Utilize resources effectively to achieve objectives within efficient cost and time.</li> <li>Provide a periodic report formatted by detailing the deviation and execution of planned tasks.</li> <strong>Problem-solving</strong><br> <p>Solve any related problems that arise and escalate any complex operational issues.</p> <strong>Quality</strong><br> <p>Ensure quality requirements to develop effective quality control and processes including specifications for products, processes, or related activities.</p> <strong>Business process improvements</strong><br> <p>Coordinate well-defined written systems, policies, procedures, and seek automation opportunities as much as possible.</p> <strong>Compliance</strong><br> <p>Comply with related policies, procedures, and work instructions.</p> <strong>Health, safety, and environment</strong><br> <p>Ensure compliance with relevant safety, quality, and environmental management procedures and controls within defined area of work activity to guarantee safety, legislative compliance, and delivery of high-quality products and services.</p> <h4>Academic qualification</h4> <p>Bachelor degree in Electrical Engineering</p> <h4>Work experience</h4> <p>2 to 4 years</p> <h4>Technical / functional competencies</h4> <p>Safety<br> Design<br> Design tools<br> Engineering design<br> Design specifications</p></p><p></p>

<h2 class="h5">Job description</h2> <div class="t-break" data-jb-field="description"> <span>Please submit your CV in English and indicate your level of English proficiency.<br> Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.<br> Participation is project-based, not permanent employment.<br>What this opportunity involves: We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.<br> You'll create challenging tasks and evaluation criteria within realistic simulated environments: Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history Design tasks from intermediate states of these environments - craft the prompt, define what "solved" means, and ensure the task is solvable by an AI agent Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust What this is NOT: Not data labeling Not prompt engineering Not writing code from scratch - the agent writes most of the code; you guide and evaluate What we look for: 8+ years in software development Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis Experience writing tests (functional, integration) English proficiency - B2+ Why this is hard: Frontier models are already good at coding.<br> Creating a task that genuinely challenges the best models is non-trivial.<br> You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution.<br> Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.<br> How it works Apply → Pass qualification(s) → Join a project → Complete tasks → Get paidEffort estimate Tasks for this project are estimated to take 30 hours to complete, depending on complexity.<br> This is an estimate and not a schedule requirement; you choose when and how to work.<br> Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.<br> Compensation: Up to $150/hr equivalent , depending on level and pace.<br> Tasks are estimated at ~30 hours each; you set your own schedule.<br></span> </div>