Data Engineer

Come Join Our Team At Anteriad  and innovate the way B2B marketers make data-driven business decisions.  About Anteriad    We are not just another B2B solution provider. We're problem solvers. We believe that data is the key to unlocking effective solutions that span a range of marketing challenges - from customer acquisition to demand generation to account-based marketing. Data is at the core of everything we do. Our team works tirelessly to create powerful solutions that drive real results for our clients. Whether it's through innovative technology or deep analysis, we're committed to finding the best path to growth for every one of our customers.      Why Join Our Database Solutions Team?    As our Data Engineer, you will support our custom data platforms. This role focuses on building, maintaining, and continuously evolving data ingestion and transformation pipelines using  Azure Data Factory, Databricks,  and emerging  Microsoft Fabric  capabilities, while preserving and reusing existing  SQL  logic wherever possible. You will play a key role as we modernize and migrate SQL Server–based workloads currently running on Azure virtual machines to Azure ‑ native data services.   You will stand out if you have hands ‑ on experience using Azure data tools as well as SQL Server experience.   Each custom data platform is actively maintained and enhanced over time to support new and evolving requests from campaign services and analytics teams. You must be comfortable working on ongoing, parallel initiatives, balancing modernization work with continuous delivery of incremental enhancements.   Anteriad means “always moving forward” and we apply that to our company culture by tirelessly promoting an environment that allows our employees to thrive:     Flexible PTO & Company Holidays   Flexible Schedule    Continuous Professional Training and Development    Mix Of Collaborative & Independent Work   Community Outreach Opportunities via Anteriad Cares    Professional Global Mentoring Program - Career Guidance From Leadership    Great Benefits For You And Your Family   Benefits We Bring To You:     Comprehensive medical (choice of 3 plans), dental and vision coverage   Company paid short-term disability, long term disability and life Insurance   Optional supplemental life, accident and critical illness insurance plans   401K with company match   Flexible PTO and generous holiday schedule   Fully paid primary caregiver leave (12 weeks) & parental bonding leave (2 weeks)   What You’ll Do:    Build and maintain data ingestion pipelines using Azure Data Factory (ADF) to move data into the corporate Azure Data Lake and related platforms.   Develop and enhance data transformation logic in Databricks notebooks, primarily leveraging SQL ‑ based transformations in existing SQL scripts and stored procedures.   Support a medallion data architecture (Bronze, Silver, Gold) with Silver and Gold datasets stored primarily in Parquet format.   Assist in migrating SQL Server–based processes (scripts, stored procedures, SSIS logic) running on Azure VMs into Azure ‑ native pipelines and Databricks transformations.   Continuously update and enhance existing database solutions and systems based on new and evolving requirements from marketing campaign activation and analytics teams, ensuring data remains accurate, timely, and fit for purpose.   Manage multiple concurrent initiatives, including modernization efforts and ongoing enhancement requests, while maintaining platform stability and data quality.   Configure Azure Data Factory pipelines to orchestrate Databricks notebooks and Fabric ‑ related processes as applicable.   Use Azure DevOps for source control, versioning, and deployment of Azure Data Factory, Databricks, and Fabric assets.   Test, monitor, and troubleshoot pipelines to ensure data reliability, performance, and quality.   Collaborate with senior engineers, project managers, campaign services, analytics, and platform teams to deliver ongoing data solutions. Participate in the adoption and use of Microsoft Fabric, understanding how Fabric components (e.g., OneLake, Lakehouse, Warehousing) integrate with existing Azure and Databricks workflows.   Maintain technical documentation for data pipelines, transformations, and datasets   What You’ll Bring:    Required Qualifications:   Hands ‑ on experience building or supporting pipelines in  Azure Data Factory.   Experience developing data transformations in  Databricks , preferably using SQL within notebooks.   Experience working with  Azure Data Lake Storage  or similar cloud storage platforms.   Familiarity with modern data lake and analytics concepts, including medallion architecture.   Experience with  SQL Server , including writing, maintaining, and understanding complex SQL scripts and stored procedures.   Experience using  Git / Azure DevOps  for source control.   Experience with  Python  for use in  Databricks  notebooks and supporting data pipeline operations.   Ability to follow established architectural patterns and implementation standards.   Strong analytical, troubleshooting, and communication skills.   Nice ‑ to ‑ Have Qualifications:   Exposure to  Microsoft Fabric , including  Lakehouse, Warehousing,  or  OneLake  concepts.   Experience integrating or evaluating  Fabric  alongside existing  Azure  and  Databricks  ecosystems.   Experience migrating SQL Server workloads from  Azure VMs  to  Azure ‑ native  or  Fabric ‑ based  platforms.   Prior exposure to  SSIS  and translating  ETL  logic into cloud ‑ based pipelines.   Familiarity with data governance and data hygiene best practices, supporting clean, consistent, and trustworthy data for downstream use.   #LIremote Our Values: Lead & Learn  We lead with unrivaled vision, innovation and execution, always learning and embracing new ways of do