Senior Data / Integration Engineer

About the role

DataSpecta is seeking a Senior Data / Integration Engineer to own the data layer of an enterprise AI estate. You will design and operate ingestion pipelines, maintain data contracts, and develop anomaly detection models for risk and security initiatives.

Key responsibilities

• Build and operate scheduled and incremental ingestion pipelines from SAP, SuccessFactors, databases and public portals.
• Consolidate recurring enterprise reports into shared, parameterised pipelines and ensure data quality through tests and reconciliation.
• Define data contracts, schema versioning and maintain lineage using OpenLineage or DataHub.
• Develop and monitor anomaly detection and classification models with drift detection.
• Troubleshoot and resolve pipeline failures caused by upstream changes.

Required profile

• 5+ years of data engineering experience with production pipeline ownership.
• Expertise in SQL (PostgreSQL, MS SQL Server, Oracle) and Python.
• Hands‑on experience with workflow orchestrators such as Airflow, Dagster or Prefect.
• Delivered at least one anomaly detection or classification model to production.
• Fluent English and based in Baku or willing to relocate.

Required skills

• SQL, Python, pandas, Polars, Parquet.
• Airflow, Dagster, Prefect, dbt, CDC.
• SAP HANA, SAP OData, RFC, SAP SuccessFactors OData.
• Playwright, Scrapy, API clients.
• Great Expectations, dbt tests, Soda, OpenLineage, DataHub.
• scikit‑learn, XGBoost, LightGBM, Isolation Forest, transformers, MLflow.