Data Engineer with Scala/Spark and Java
Comtech LLC
Apply to this jobComtech LLC is a woman-owned small business focused on delivering end-to-end solutions and products. Since 1998, we have successfully serviced enterprises across the public and private sectors, and the Department of Defense. Our services span all aspects of business, providing a holistic approach for managing an organization.
- Big Data experience
- 8+ years exp in Java, Python and Scala
- With Spark and Machine Learning (3+)
- Data mining, Data analysis
- Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
- Work closely with our engineering team to integrate and build algorithms
- Process unstructured data into a form suitable for analysis – and then do the analysis.
- Support business decisions with ad hoc analysis as needed
- Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools
- Inform the selection of appropriate modeling techniques to ensure that predictive models are developed using rigorous statistical processes
- Establish and maintain effective processes for validating and updating predictive models
- Analyze, model, and forecast health service utilization patterns/ trends and create capability to model outcomes of what-if scenarios for novel health care delivery models
- Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products
- Perform statistical analysis to prioritize in order to maximize success
- Identify areas for improvement, communicating action plans
- Perform strategic data analysis and research to support business needs
- Identify opportunities to improve productivity via sophisticated statistical modeling
- Explore data to identify opportunities to improve business results
- Develop understanding of business processes, goals and strategy in order to provide analysis and interpretation to management
- Gain understanding of business needs and necessary analysis where appropriate through internal discussion
Bachelors or Masters in related field
All your information will be kept confidential according to EEO guidelines.
Summary
Develop and optimize data processing, analysis, and predictive modeling solutions at scale.
Job title
Data Engineer with Scala/Spark and Java
Experience level
8+ years
Industry
software
Location requirements
San Jose, CA, with remote options allowed
Salary
Not specified
Management role
No
Required skills
Preferred skills
Specializations
Structured locations inferred from the posting.
San Jose, CA, USA