Big Data Engineer

SP Software Solutions

Apply to this job
Mountain View, CA, us on site Until 8/22/2026 First posted March 26, 2025 Last posted March 26, 2025
Job description
  • Translate business requirements and source system understanding into technical solutions using Opensource Tech Stack, Big Data & Java etc.
  • Work with business partners directly to seek clarity on requirements
  • Define solutions in terms of components, modules and algorithms
  • Design, develop, document and implement new programs  and subprograms, as well as enhancements, modifications, and corrections  to existing software. 
  • Create technical documentation and procedures for installation and maintenance.  
  • Write Unit Tests covering known use cases using appropriate tools
  • Integrate test frameworks in development process
  • Refactor existing solutions to make it reusable and scalable
  • Work with operations to get the solutions deployed
  • Take ownership of production deployment of code
  • Collaborating with and/or lead cross functional  teams, build and launch applications and data platforms at scale, either for revenue generating or operational purposes
  • Come up with Coding and Design best practices
  • Thrive in self-motivated internal-innovation driven environment
  • Adapting fast to new application knowledge and changes

• Master/Bachelor degree in Computer Science, Electrical Engineering, Information Systems or other technical discipline; advanced degree preferred.
• Minimum of 2+ years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in leveraging standard development best practice methodologies.
• Minimum 1+ years of experience in Python, Pandas and SQL
• Strong knowledge of Database concepts and Python.
• Expert on SQL skills for data manipulation (DML) and validation (SQL Server, DB2, Oracle).
• Expertise in Object Oriented Programming Language – Java / Python.
• Experience using CI/CD Process, version control and bug tracking tools.
• Experience in handling very large data volume in low latency and batch mode.
• Experience with automation of job execution, validation and compares of the data files on Hadoop Env at the field level.
• Experience in leading a small team and be a team player.
• Strong communication skills with proven ability to present complex ideas and document in a clear and concise way.
• Quick learner; self-starter, detailed and in-depth.

All your information will be kept confidential according to EEO guidelines.

About this role

Summary

Develop and deploy scalable data solutions using open source tech, Java, Python, and SQL.

Job title

Big Data Engineer

Experience level

2+ years

Industry

software

Location requirements

Mountain View, CA, US; remote not specified

Salary

Not specified

Management role

Yes

Skills & keywords

Required skills

javapythonsqlhadoopversion control

Preferred skills

CI/CDautomationteam leadership

Specializations

big datajavapythonsqlhadoop
Locations

Structured locations inferred from the posting.

Mountain View, CA, USA

On-site City