Skills :-
- Builds and optimizes scalable data pipelines and ETL processes
- Skilled in SQL, Python, and big data tools like Spark and Hadoop
- Experienced with AWS, GCP, and Azure cloud data services
- Designs efficient data models and architectures
- Ensures data quality, governance, and system reliability
- Automates workflows using tools like Airflow and DBT
- Supports analytics teams with clean, reliable data
Requirements :-
- 3+ years of hands-on experience in Big Data technologies like Apache Beam, Spark, and Hadoop.
- Proficient in Python, Java, or Golang for scalable data pipeline development.
- Confident working in cloud environments, especially AWS.
- Skilled in optimizing data workflows for performance and cost efficiency.
- Passionate about learning new tools and building reliable data infrastructure.
- Strong communication skills in English, both written and spoken.
- Experience with ClickHouse is a plus.
Job Responsibility :-
- Ensure data quality and integrity for time series analysis, focusing on accuracy, consistency, and client usability.
- Design, build, and maintain Big Data pipelines on AWS, optimizing for scalability, performance, and cost-effectiveness.
- Lead innovation by researching emerging technologies and proposing impactful architectural improvements.
- Drive automation through CI/CD workflows and clean, efficient, well-documented Python code.
- Collaborate with cross-functional teams to streamline data access via SQL, APIs, and infrastructure enhancements.
- Contribute to the development and maintenance of streaming data pipelines (e.g., Dataflow, Pub/Sub, Bigtable, BigQuery), ensuring reliability at scale.
Who are looking for :-
We’re looking for a detail-oriented and skilled Data Engineer to design, build, and optimize scalable data pipelines and infrastructure. In this role, you’ll enable data-driven decision-making by ensuring the reliability, efficiency, and performance of our data systems. Ideal candidates thrive at the intersection of software engineering and data architecture.
Asterdio Incorporated Pvt.Ltd
Asterdio is a technology & design partner for the most demanding companies. With over 5 years of experience and 30+ specialists on board, we offer a complete range of custom software development solutions: web and mobile development, product design, DevOps services, and quality assurance tied together with branding and identity design.
For years, we’ve been helping clients in need of PHP and JavaScript development which makes us a real powerhouse when it comes to these technologies.
https://asterdio.com/Similar Jobs
Ruby on Rails Developer
IT Jobs
Full Time
Site Reliability Engineer (SRE)
IT Jobs
Full Time
Senior Java Microservices
IT Jobs
Full Time
Senior Software Engineer
IT Jobs
Full Time
Senior Software Engineer(Ruby on Rails)
IT Jobs
Full Time
Senior Software Engineer
IT Jobs
Full Time
Upload Your CV