Storygold is hiring a Principal CAD Evaluation Engineer to own the end-to-end evaluation of language models performing complex tasks inside parametric CAD systems.
This is not a mechanical-design or generic QA position. The role requires deep knowledge of CAD software internals, strong software-engineering ability, and the technical judgment to design, implement, and run rigorous CAD evaluations.
Responsibilities
- Design benchmark tasks and evaluation protocols for parametric CAD workflows
- Write and refine prompts, tool instructions, scoring criteria, and evaluation rubrics
- Build execution harnesses that operate CAD software through APIs and automation interfaces
- Develop automated validators, graders, regression tests, and diagnostic tools
- Programmatically inspect CAD documents, feature trees, sketches, constraints, assemblies, configurations, references, and rebuild states
- Analyze B-rep topology, geometric validity, tolerances, mass properties, and model structure
- Determine whether failures originate from model reasoning, tool use, CAD automation, feature regeneration, constraint solving, the geometry kernel, or the evaluator itself
- Combine deterministic checks with expert technical review
- Define failure taxonomies and maintain consistent evaluation standards
- Work with CAD task creators and research engineers to improve benchmark quality and coverage
Requirements
- 7+ years of experience developing CAD, CAM, CAE, geometric-modeling, or related engineering software
- Deep understanding of parametric CAD architecture, including:
- B-rep geometry and topology
- Feature history, dependency graphs, and regeneration
- Sketch and assembly constraint systems
- Geometric tolerances and model validity
- Boolean operations, intersections, offsets, fillets, and healing
- Topological naming and reference stability
- CAD file translation and interoperability
- Strong software-engineering ability in C++ or C#/.NET
- Practical experience with Python for automation, data processing, and evaluation pipelines
- Experience working with CAD APIs, geometry kernels, automated testing, or model-validation systems
- Professional experience with SolidWorks, NX, CATIA, Creo, Onshape, Fusion, Inventor, Solid Edge, or a comparable parametric CAD platform
- Strong debugging, systems-design, and technical communication skills
- English proficiency at B2 level or higher
Preferred Qualifications
- Experience with SolidWorks API or SolidWorks automation
- Experience with Parasolid, ACIS, CGM, Open Cascade, C3D, or another commercial geometry kernel
- Experience developing production CAD software or geometric algorithms
- Experience building technical benchmarks, evaluation systems, automated graders, or test infrastructure
- Experience evaluating systems that use language models and external software tools