BA
Principal Vision Systems Engineer
Accepting applicationsBrooks Automation · Chelmsford, MA
Full-Time Principal C++CMOSFPGAMATLABPython
Posted
2d ago
Category
Design
Experience
Principal
Country
United States
Brooks is a leading provider of automation solutions with over 40 years of experience in the semiconductor industry, offering precision robotics, integrated automation systems, and contamination control solutions that empower chip manufacturers worldwide. Our product portfolio includes a range of automation solutions, including robots, vacuum systems, and atmospheric robots for semiconductor manufacturing (www.brooks.com).
Are you looking for a place where you can be part of a transformation? Join us at Brooks Automation and be a part of a dynamic organization that is shaping the future of technology.
Principal Vision Systems Engineer
Job Description
Position Summary
We are seeking a Principal Vision Systems Engineer to lead the development of a next-generation ultra-high-speed, ultra-low-latency vision-based position feedback system for precision control of magnetically levitated rigid bodies.
This role will serve as the technical owner of the vision system, overseeing the co-development of a custom smart camera and FPGA-based image processing platform and delivering real-time 6DOF pose estimation with deterministic latency performance (<100 µs) and high update rates (>2 kHz).
The successful candidate will work across computer vision, embedded systems, FPGA architecture, and control system integration to enable closed-loop control performance beyond current commercial solutions.
Key Responsibilities
System Architecture & Technical Leadership
Own the end-to-end vision system architecture:
Image acquisition
FPGA-based processing
Target extraction
6DOF pose estimation
Controller interface and synchronization
Define HW/SW/FPGA partitioning aligned with performance goals
Lead design trade-offs (resolution vs speed vs latency vs field of view)
Algorithm Development (Real-Time / FPGA-Oriented)
Develop algorithms for:
Sub-pixel target extraction
Multi-body tracking
Real-time 6DOF pose estimation
Translate prototype algorithms (MATLAB/Python) into FPGA-compatible implementations
Optimize for deterministic latency and minimal jitter
FPGA Co-Development Oversight
Collaborate with external partner on:
Smart camera development
FPGA processing pipelines
Guide FPGA implementation strategy and architecture
Participate in design reviews and risk mitigation
Controller Integration & Closed-Loop Performance
Define low-latency interfaces between vision system and controller
Ensure deterministic timing and synchronization
Validate performance in closed-loop control applications
Performance Validation & Testing
Define validation plans for:
Latency and jitter
Spatial accuracy
Multi-target tracking robustness
Benchmark against existing systems
Sensor & Optical System Specification
Lead evaluation of:
High-speed CMOS sensors
Precision optical systems
Support system-level trade studies
Program Leadership
Serve as technical interface to external development partner
Drive architecture definition and technical milestones
Lead cross-functional collaboration (controls, hardware, software)
Basic Qualifications (Required)
MS or PhD in Computer Vision, Electrical Engineering, Robotics, or related field
10+ years of experience in:
Vision systems
Real-time or embedded systems
Proven experience delivering low-latency vision or sensor-based systems
Technical Skills
3D pose estimation (PnP, multi-camera systems)
Sub-pixel feature extraction and tracking
Camera calibration (intrinsic/extrinsic)
Real-time system design and latency optimization
Programming: C/C++, Python, MATLAB
Embedded / FPGA Knowledge
Understanding of FPGA-based image processing pipelines
Fixed-point arithmetic and hardware constraints
Experience collaborating with FPGA teams
Preferred Qualifications
Experience in:
Semiconductor or precision automation systems
Metrology-grade measurement systems
Closed-loop motion control
Familiarity with:
Industrial vision standards (GigE Vision, GenICam)
Deterministic communication interfaces (SPI, BiSS, FPGA-based links)
Key Performance Objectives
Deliver system architecture supporting:
>2 kHz update rate
<100 µs latency
Complete FPGA-based proof-of-concept with external partner
Demonstrate stable low-jitter performance in closed-loop control
Enable integration into levitated rigid body system
Competencies
Systems-level thinking and architecture ownership
Strong analytical and problem-solving skills
Cross-functional collaboration
Technical communication with internal and external teams
Ability to execute in high-uncertainty development environments
Compensation
Base Salary Range: $132,456.81 USD to $179,206.28 USD
Factors which may affect starting pay within this range may include geography/market, skills, education, experience and other qualifications of the successful candidate.
This position is also eligible for an annual discretionary bonus.
Benefits
At Brooks, we offer the following benefits for this position, subject to applicable eligibility requirements:
Medical, Dental, Vision and Disability Insurance
401(k) Plan
Exempt employees are provided company paid holidays and Flexible Vacation to enjoy personal time off and incidental sickness.
Have a question about our benefits and compensation package? Your recruiter can share more with you during the hiring process.
Work Location & Flexibility
At Brooks, we aim to foster a collaborative and engaging environment while offering flexibility where possible. Work arrangements may include a mix of in-office and remote work, depending on the nature of the role and business needs. Specific expectations will be shared during the interview process.
Brooks is committed to fostering a diverse and inclusive workplace and proudly serves as an equal-opportunity employer. We welcome all qualified applicants regardless of race, color, religion, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status, or any other legally protected characteristics.
Diversity enhances our innovative capabilities and strengthens our ability to serve our customers and communities effectively. At Brooks Automation, we celebrate the unique experiences and perspectives each individual brings, believing they are essential to our collective success. Join us in building a workplace where every team member is valued and can thrive.
For applicants with disabilities requiring accommodations, don't hesitate to get in touch with talentattraction@brooks.com or call +1 (978) 262-2400 to discuss your needs.
Review EEO Law & EEO Statement.
Brooks Automation participates in E-Verify® to confirm eligibility for employment in the United States. For more details, visit www.dhs.gov/E-Verify. E-Verify® is a registered trademark of the U.S. Department of Homeland Security.
Show more Show less
Are you looking for a place where you can be part of a transformation? Join us at Brooks Automation and be a part of a dynamic organization that is shaping the future of technology.
Principal Vision Systems Engineer
Job Description
Position Summary
We are seeking a Principal Vision Systems Engineer to lead the development of a next-generation ultra-high-speed, ultra-low-latency vision-based position feedback system for precision control of magnetically levitated rigid bodies.
This role will serve as the technical owner of the vision system, overseeing the co-development of a custom smart camera and FPGA-based image processing platform and delivering real-time 6DOF pose estimation with deterministic latency performance (<100 µs) and high update rates (>2 kHz).
The successful candidate will work across computer vision, embedded systems, FPGA architecture, and control system integration to enable closed-loop control performance beyond current commercial solutions.
Key Responsibilities
System Architecture & Technical Leadership
Own the end-to-end vision system architecture:
Image acquisition
FPGA-based processing
Target extraction
6DOF pose estimation
Controller interface and synchronization
Define HW/SW/FPGA partitioning aligned with performance goals
Lead design trade-offs (resolution vs speed vs latency vs field of view)
Algorithm Development (Real-Time / FPGA-Oriented)
Develop algorithms for:
Sub-pixel target extraction
Multi-body tracking
Real-time 6DOF pose estimation
Translate prototype algorithms (MATLAB/Python) into FPGA-compatible implementations
Optimize for deterministic latency and minimal jitter
FPGA Co-Development Oversight
Collaborate with external partner on:
Smart camera development
FPGA processing pipelines
Guide FPGA implementation strategy and architecture
Participate in design reviews and risk mitigation
Controller Integration & Closed-Loop Performance
Define low-latency interfaces between vision system and controller
Ensure deterministic timing and synchronization
Validate performance in closed-loop control applications
Performance Validation & Testing
Define validation plans for:
Latency and jitter
Spatial accuracy
Multi-target tracking robustness
Benchmark against existing systems
Sensor & Optical System Specification
Lead evaluation of:
High-speed CMOS sensors
Precision optical systems
Support system-level trade studies
Program Leadership
Serve as technical interface to external development partner
Drive architecture definition and technical milestones
Lead cross-functional collaboration (controls, hardware, software)
Basic Qualifications (Required)
MS or PhD in Computer Vision, Electrical Engineering, Robotics, or related field
10+ years of experience in:
Vision systems
Real-time or embedded systems
Proven experience delivering low-latency vision or sensor-based systems
Technical Skills
3D pose estimation (PnP, multi-camera systems)
Sub-pixel feature extraction and tracking
Camera calibration (intrinsic/extrinsic)
Real-time system design and latency optimization
Programming: C/C++, Python, MATLAB
Embedded / FPGA Knowledge
Understanding of FPGA-based image processing pipelines
Fixed-point arithmetic and hardware constraints
Experience collaborating with FPGA teams
Preferred Qualifications
Experience in:
Semiconductor or precision automation systems
Metrology-grade measurement systems
Closed-loop motion control
Familiarity with:
Industrial vision standards (GigE Vision, GenICam)
Deterministic communication interfaces (SPI, BiSS, FPGA-based links)
Key Performance Objectives
Deliver system architecture supporting:
>2 kHz update rate
<100 µs latency
Complete FPGA-based proof-of-concept with external partner
Demonstrate stable low-jitter performance in closed-loop control
Enable integration into levitated rigid body system
Competencies
Systems-level thinking and architecture ownership
Strong analytical and problem-solving skills
Cross-functional collaboration
Technical communication with internal and external teams
Ability to execute in high-uncertainty development environments
Compensation
Base Salary Range: $132,456.81 USD to $179,206.28 USD
Factors which may affect starting pay within this range may include geography/market, skills, education, experience and other qualifications of the successful candidate.
This position is also eligible for an annual discretionary bonus.
Benefits
At Brooks, we offer the following benefits for this position, subject to applicable eligibility requirements:
Medical, Dental, Vision and Disability Insurance
401(k) Plan
Exempt employees are provided company paid holidays and Flexible Vacation to enjoy personal time off and incidental sickness.
Have a question about our benefits and compensation package? Your recruiter can share more with you during the hiring process.
Work Location & Flexibility
At Brooks, we aim to foster a collaborative and engaging environment while offering flexibility where possible. Work arrangements may include a mix of in-office and remote work, depending on the nature of the role and business needs. Specific expectations will be shared during the interview process.
Brooks is committed to fostering a diverse and inclusive workplace and proudly serves as an equal-opportunity employer. We welcome all qualified applicants regardless of race, color, religion, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status, or any other legally protected characteristics.
Diversity enhances our innovative capabilities and strengthens our ability to serve our customers and communities effectively. At Brooks Automation, we celebrate the unique experiences and perspectives each individual brings, believing they are essential to our collective success. Join us in building a workplace where every team member is valued and can thrive.
For applicants with disabilities requiring accommodations, don't hesitate to get in touch with talentattraction@brooks.com or call +1 (978) 262-2400 to discuss your needs.
Review EEO Law & EEO Statement.
Brooks Automation participates in E-Verify® to confirm eligibility for employment in the United States. For more details, visit www.dhs.gov/E-Verify. E-Verify® is a registered trademark of the U.S. Department of Homeland Security.
Show more Show less