Custom Software Engineer

Project Role : Custom Software Engineer
Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact.
Must have skills : PySpark
Good to have skills : NA
Minimum 3 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Custom Software Engineer, a typical day involves leading the design, development, and configuration of software applications. This role requires taking ownership of the project s technical direction and serving as the main liaison for all application-related activities. The position demands close collaboration with various stakeholders to ensure that the solutions meet business needs while maintaining high standards of quality and performance. The engineer actively manages the application lifecycle, from initial concept through deployment and ongoing support, ensuring seamless integration and functionality within the broader system environment.

Roles & Responsibilities:
ETL/ELT development
Data modeling
Data warehousing concepts
Lakehouse architecture
Batch and streaming pipelines
Performance Optimization
Query optimization
Execution plan analysis
Adaptive Query Execution (AQE)
Join optimization
Partition pruning
Broadcast joins
Skew handling
Caching strategies
File optimization
Cluster resource tuning
Storage Formats
Delta Lake
Apache Iceberg
Parquet
ORC
CI/CD & DevOps
Git
CI/CD pipeline
Docker/Kubernetes (preferred)

Preferred Qualifications
Experience with Databricks, IoMete, EMR, Synapse, or Microsoft Fabric.
Knowledge of Kafka or event-driven architectures.
Experience building data products for AI/ML workloads.
Familiarity with data governance and metadata management.

Experience
5–10 years in Data Engineering.
3+ years of hands-on experience with PySpark and distributed computing.
Proven experience processing large-scale datasets (multi-TB/PB).
Strong track record in Spark performance tuning, query optimization, and building enterprise-grade data products.

Professional & Technical Skills:
- Must To Have Skills: Proficiency in PySpark.
- Strong knowledge of distributed computing principles and big data processing frameworks.
- Experience in writing efficient, reusable, and maintainable code for large-scale data processing.
- Familiarity with data integration techniques and working with various data sources.
- Ability to troubleshoot and optimize complex data workflows and pipelines.
- Understanding of software development lifecycle and version control systems.

Additional Information:
Key Competencies
PySpark development
Spark performance tuning
High-volume data processing
Complex SQL optimization
Distributed systems engineering
Data product engineering
Data modeling
Lakehouse architecture
Cloud data engineering
Production support and troubleshooting
Performance benchmarking and scalability optimization

15 years full time education

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com 

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.