The Senior Data Engineer is responsible for managing the development and maintenance of the company’s data infrastructure and analytics pipelines. This role focuses on creating simple, scalable, and high-performing data solutions to support business intelligence and AI initiatives.
DUTIES AND RESPONSIBILITIES |
- Architect and oversee data warehouse technical designs in Snowflake to ensure scalability, stability, and security.
- Develop and maintain automated data integration pipelines using ETL platforms and Snowflake to ingest data from various business systems.
- Build and optimize transformation layers and data models to support reporting and visualization in Power BI.
- Contribute directly to the design, development, and deployment of AI tools and machine learning datasets.
- Enforce code quality standards and peer review processes to ensure the stability of the data environment.
- Maintain technical documentation for all data models, integrations, and transformation logic.
- Troubleshoot data discrepancies and pipeline failures, developing long-term fixes rather than temporary workarounds.
- Collaborate extensively with the Chief Analytics Officer and project teams to translate business requirements into technical data solutions.
- Research and provide feedback on new AI/ML technologies and data tools being considered for implementation.
- All other duties as assigned.
- Strong knowledge of the software development lifecycle (SDLC) and data engineering best practices.
- 3-4 years of experience with advanced Database administration and development.
- Extensive knowledge of SQL for complex data transformation and optimization.
- 3-4 years of experience writing Python code for data automation and scripting.
- Experience with enterprise integration platforms and BI tools
- Demonstrated ability to research and resolve complex data problems using a variety of resources.
- Strong planning and organizational skills to manage multiple data work efforts simultaneously.
On-call availability for rotation during the week and weekends. Remote work
Employee may experience the following physical demands for extended periods of time: Sitting for extended periods of time; use of hands and fingers to operate a computer keyboard, mouse, sorter, power tools, and to handle other computer components; occasional climbing or bending to inspect cables in floors and ceilings; lifting and transporting of moderately heavy objects, such as computers and peripherals.
N/A
Must be at least 18 years of age.
WE ARE AN EQUAL OPPORTUNITY EMPLOYER
Export Control Compliance Notice
This position may involve access to technology or software source code subject to U.S. export control laws (ITAR/EAR). Employment is contingent on verifying U.S. Person status or obtaining any necessary export license/confirming the availability of a license exception. Applicants must provide information for export control screening, which will be reviewed for compliance. Palmetto State Armory may elect not to pursue a license or exception and may decline to proceed with an applicant on that basis.