Cybersecurity Engineer - AI Benchmarking Lead
Gramian Consulting
Job description
About the role
A boutique IT consultancy is looking for an experienced Lead Software Security Engineer to lead a team of trainers building training and evaluation tasks for frontier AI coding models. The project turns real-world open-source vulnerabilities (CVEs, security advisories, bug reports) into Harbor-format audit-and-patch tasks across many programming languages, testing whether AI systems can identify, understand, reproduce and remediate vulnerabilities. This is a 3-month, fully remote contractor engagement starting next week, at 40 hours per week, with a minimum of 4 hours of overlap with PST.
Key responsibilities
- Plan task deliveries by batch, assign work to pod members and track daily throughput against phase targets
- Monitor pod performance, resolve bottlenecks and keep tasks moving through production stages on schedule
- Lead weekly client reporting, communicate delivery status and escalate risks such as tooling issues, rate limits, safety blocks and resource constraints
- Clarify requirements and scope with the client, including volume, complexity and difficulty changes
- Review completed tasks for quality, security, reproducibility and evaluation standards
- Train and calibrate Pod Leads and trainers on CWE classification, verifier robustness, task difficulty and acceptance criteria
- Forecast staffing needs from throughput and quality data, and run hiring and onboarding waves about three weeks ahead of capacity needs
- Contribute hands-on: research vulnerabilities, reproduce issues, write proof-of-vulnerability tests and create or review benchmark tasks during busy periods
- Maintain documentation of delivery plans, risks, quality findings, throughput metrics, staffing forecasts and project decisions
Required profile
- 6+ years of professional software engineering experience
- Expert-level proficiency in at least one of Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP or Kotlin
- Strong understanding of software security concepts including CWE, CVE and OWASP Top 10
- Ability to reproduce vulnerabilities and write proof-of-vulnerability tests
- Experience reviewing technical work and mentoring engineers, trainers or contributors
- Proven track record on this project or equivalent software security dataset, benchmark development or security evaluation work
Required skills
- Security tooling: sanitizers, fuzzers and static analysis tools such as CodeQL or Semgrep
- Git, Linux, Bash and Docker
- Technical writing, documentation and communication; independent work in a fully remote, research-oriented setting
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Turkey.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 8 hours ago
Expires 1 month from now
9 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Gramian Consulting
Related job offers
-
Software Development Team Lead - Java Backend
Gizli Istanbul -
Çözüm Mimarı – Siber Güvenlik ve Bilgi Güvenliği Projeleri
SecHard Ankara -
Sistem ve Network Uzmanı – Otoyol İşletmesi
RÖNESANS HOLDİNG Istanbul -
Engineering Manager - Software Security & AI Benchmark Delivery
Gramian Consulting -
Reasürans Raporlama Uzmanı
Gizli Şirket Istanbul