Note: The job is a remote job and is open to candidates in USA. Data Based Development Systems is seeking a Data Engineer with experience in complex data solutions. The role involves designing, developing, implementing, and maintaining data pipelines on the Azure Cloud platform using tools such as HVR, Snowflake, and Matillion.
Responsibilities
- Must be a US Citizen
- Design, develop, implement, and maintain data pipelines in Azure Cloud platform using HVR, Snowflake, and Matillion
- Expert in HVR replication of SAP data sources to Snowflake
- Strong understanding of Snowflake architecture, features, and functionalities (e.g., virtual warehouses, data sharing, Snowpipe, data storage, and compute separation)
- Experience in designing, developing, and optimizing Snowflake-based data solutions. Includes SQL stored procedures and views
- Experience with Matillion ELT to extract, load, and transform data into Snowflake, leveraging the medallion architecture for the Snowflake progression of data
- Familiarity with Matillion components, such as orchestration jobs, transformation jobs, variables, and connectors
- Strong analytical and problem-solving skills
- Strong communication skills
- Partnership with business analysts and customers to validate results and refine solutions as needed to meet business needs
- Databricks knowledge would be a plus
Skills
- Must be a US Citizen
- Expert in HVR replication of SAP data sources to Snowflake
- Strong understanding of Snowflake architecture, features, and functionalities (e.g., virtual warehouses, data sharing, Snowpipe, data storage, and compute separation). Experience in designing, developing, and optimizing Snowflake-based data solutions. Includes SQL stored procedures and views
- Experience with Matillion ELT to extract, load, and transform data into Snowflake, leveraging the medallion architecture for the Snowflake progression of data. Familiarity with Matillion components, such as orchestration jobs, transformation jobs, variables, and connectors
- Strong analytical and problem-solving skills
- Strong communication skills
- Partnership with business analysts and customers to validate results and refine solutions as needed to meet business needs
- Databricks knowledge would be a plus
Company Overview