2419 Data Engineer Python Pyspark jobs in New York,NY

New, Posted 4 hours ago

Apply Directly

Sr. Data Engineer

Subway Restaurants

Wilton, CT 06897

$119,200-$149,000/yr

~ 1 hr 8 min OnsiteEducation AssistanceHealth InsuranceRetirement Benefit

Bachelor's degree in Computer or Information Science or related field, or equivalent combination of education and experience
5–8 years creating quality data pipelines and system integrations
At least 3 years of experience in a cloud environment
Hands-on experience building lakehouse solutions on Databricks (Delta Lake, Unity Catalog) or Snowflake (Iceberg Tables, Horizon Catalog)
Proven ability to design Bronze/Silver/Gold layers for curated, analytics-ready data
Experience implementing Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake Dynamic Tables / Snowpipe Streaming
Experience building and managing semantic models using Databricks AI/BI Genie or Unity Catalog Metrics or Snowflake Semantic Views / Cortex Analyst
Building pipelines with Airflow, Databricks Lakeflow, or Snowflake Openflow; familiarity with dbt is a plus
Strong PySpark or advanced SQL skills; Python for data engineering or automation
Dimensional modeling, Data Vault, or schema design for analytical workloads
Cluster/warehouse sizing, partitioning, clustering keys, Z-ordering, or query optimization
Working knowledge of Unity Catalog (Databricks) or Horizon Catalog (Snowflake) for lineage, access control, or data quality
Git, Databricks Asset Bundles or Snowflake CLI/Schemachange, automated testing, or deployment pipelines
AWS (S3, Glue, Kinesis), Azure, or GCP services supporting modern data platforms
Familiarity with Databricks Mosaic AI or Snowflake Cortex for GenAI or ML use cases
Strong communication skills to partner with Product Owners, Analysts, or cross-functional engineering teams
Authorized to work in the country the position is based