DATA ENGINEER

Job Description of Senior Data Engineer

Our client, a Netherlands digital consulting company, is looking for 1 Senior Data Engineer to join their team. Our client builds a standard banking application, which has onboarding, transactions accounts, and ETFs against which an Analytics reporting dashboard needs to be built.

The Senior Data Engineer will be responsible for developing and maintaining the server-side components of data-centric applications. Working closely with data scientists, data analysts, and other members of the development team to design, build, and optimize data processing systems and pipelines. He will be the primary Data engineer, having face time with the client to make the data dashboards. In addition, there are no other data engineers in our client’s team. There are two solution architects, back-end and front-end tech leads, and a large dev team of about 40+ people. There is data engineering guidance and support that is provided by the Data chapter leadership in Amsterdam.

Deliverables:
Data Pipeline Development: Designing and implementing efficient and scalable data pipelines that extract, transform, and load (ETL) data from various sources into target systems, such as data warehouses or analytics platforms.
Database Design and Management: Collaborating with data architects and database administrators to design and optimize databases for performance, scalability, and reliability. This includes data modeling, indexing, and query optimization.
Backend Development: Writing clean, maintainable, and efficient code in languages like Python, Java, Scala, etc. to implement backend functionalities required for data processing and storage. This could involve developing RESTful APIs, microservices, or serverless functions.
Data Transformation and Integration: Applying data transformation techniques to ensure data quality, consistency, and compatibility across different systems. This may involve data cleaning, normalization, aggregation, and integration with external data sources.
Performance Optimization: Identifying performance bottlenecks in data processing workflows and optimizing algorithms, queries, and infrastructure components to improve overall system performance and throughput.
Data Security and Compliance: Implementing data security measures, such as access controls, encryption, and data anonymization, to ensure compliance with privacy regulations and protect sensitive data.
Collaboration and Communication: Collaborating with cross-functional teams, including data scientists, front-end engineers, and product managers, to understand requirements, provide technical insights, and ensure seamless integration between front-end and back-end systems.
Testing and Deployment: Writing unit tests and participating in code reviews to maintain code quality and reliability. Contributing to the deployment process, including version control, continuous integration, and deployment automation.
Monitoring and Maintenance: Monitoring data pipelines, identifying issues or anomalies, and performing troubleshooting and maintenance tasks to ensure data integrity and system availability.
Seeking a dynamic candidate with exceptional communication and listening skills, capable of engaging effectively with senior managers and executives to facilitate insightful discussions on the intricacies of data analytics.

Duration: 6+ months

English: Fluent

Location: Remote

Working hours: GTM +7

Qualification Process:

The developer will join 2-3 rounds of interviews with the client’s engineers, architects, and data chapter experts based in Australia and Amsterdam.