Role: Sr. Data Engineer
Location: Pennington/ Jersey City, NJ - ( Hybrid)
Hire Mode: Full Time only
Job Description:
• Design and develop scalable data pipelines using modern data stack technologies for Pershing X’s Cloud data platform.
• Write ETL processes, design data applications and develop data pipelines for Operational Business Intelligence Mart
• Role involves analyzing technical metadata, Data Pipeline logs and data lineage for data platform, and providing insights to support data platform operational decisions.
• Collaborate with cross-functional teams to understand and Elucidate Observability requirements for the data platform considering SLA, operational needs, DQ and proactive monitoring.
• Work with other engineers on the team to elevate technology and consistently apply best practices.
Required Skill and Experience:
• A minimum of five (5) years of IT experience in data engineering or data management field
• 4 - 5 years of experience in application development using SQL, PLSQL
• Strong working knowledge and min of 2 years’ experience in DBT, Snowflake
• Recent experience as a Senior Data Engineer in any public cloud, preferably on Azure as well as on a cloud warehouse like Snowflake is required
• 2+ years of experience in building data pipelines using various ETL and ELT tools
• Hands-on experience with Airflow is highly preferred
• Experience in building cloud native solutions, preferably on Azure including the use of DevOps CI / CD tools and containers.
• Proven experience as a Data Analyst or in a similar role.
• Strong proficiency in Data Modelling, process metadata, observability, and monitoring data platforms.
• Familiarity with data modelling tools / techniques is a plus
• Azure or Snowflake training / certification is a plus
• Strong analytical, problem solving, communication, collaborative and organizational skills
• Self-driven, self-directed, passionate analytical and focused on delivering the right results
Key Skills: