Worldwide
- Worldwide
PythonSQLKafkaAWS+4
Ditemukan hari ini · HimalayasLamar
Data Platform Engineer (102-08SENG-01)
Gaji
Tidak dicantumkan
Tanyakan saat wawancara
Wilayah
Worldwide
Worldwide
Tipe kerja
Penuh waktu
Remote penuh
Level
Tidak disebut
Zona waktu
Fleksibel / tidak disebut
Bahasa Inggris lancar
Diposting
Invalid Date
Dicek hari ini
Kenapa lowongan ini bisa dilamar dari Indonesia
Lokasi yang ditulis perusahaan: "Worldwide". Terbuka untuk kandidat dari mana saja (worldwide).
Keputusan akhir tetap di perusahaan. Baca deskripsi lengkap sebelum melamar.
Seberapa cocok CV-mu?
Unggah CV sekali, lalu cek skor kecocokan, kekuatan, dan kekurangan untuk setiap lowongan.
Masuk untuk cekKeahlian yang disebut
PythonSQLKafkaAWSAzureTerraformSparkAirflowdbt
Deskripsi pekerjaan
2 menit bacaThis role converts a large Azure Data Factory estate into Databricks workflows on AWS. The scope for year one: 2,094 ADF pipelines to migrate — built as reusable templates rather than one-by-one — 9,859 pipeline activities to translate (some map directly, others need rewriting as Lambda or Step Functions), 471 Spark dataflows to move onto Databricks on AWS, and 4 Databricks workspaces (Dev, QA, Pre-prod, Prod) to rehost, including notebook paths and Unity Catalog rewiring. This is a regulated environment, so reconciling migrated data against source systems is part of the definition of done, not an afterthought.
Requirements
What you will do
Convert Azure Data Factory pipelines into Databricks workflows on AWS, building reusable templates rather than migrating one at a time.
Rehost Databricks workspaces onto AWS and migrate ADLS Gen2 storage to S3.
Rewrite ADF Web Activities as Lambda functions or Step Functions tasks, and replace ADF-specific scaling with native Databricks mechanisms.
Build and tune PySpark transformations for production data volumes.
Replace Azure Synapse Serverless with Databricks SQL Warehouse.
Reconcile migrated data against source systems as part of the definition of done.
Required
Production experience with Databricks: workspaces, jobs and workflows. The central skill for this role.
Strong Spark and PySpark experience for real data volumes, including tuning.
Production-grade Python
Experience building or migrating Azure Data Factory pipelines, with a solid understanding of the ADF activity model.
AWS data services: S3, Glue, Athena, Lambda and Step Functions.
Advanced SQL, including reading and reasoning about stored procedures.
Professional written and spoken English
Nice to have
Delta Lake, Unity Catalog, Azure Synapse, Terraform, Airflow/MWAA, dbt, Kafka, Databricks certification, data modeling, Great Expectations, SAS/analytics platform integration, CRM data.
Engagement details
Full-time
100% remote
Open to candidate from all LATAM
Highlights
Databricks, PySpark, Python, Azure Data Factory, AWS (S3, Glue, Athena, Lambda, Step Functions), SQL, Delta Lake, Unity Catalog, Azure Synapse, Terraform, Airflow/MWAA, dbt, Kafka
Originally posted on Himalayas
Hitung gaji bersih dalam rupiah
Kotor per bulanRp0
Biaya transfer & kurs− Rp0
Perkiraan PPh 21 per bulan − Rp0
Diterima bersih per bulanRp0
Bersih setahunRp0
Perkiraan kasar: kurs USD Rp17.800; pajak dihitung sebagai penghasilan orang pribadi (tarif progresif PPh 21, dikurangi PTKP), tanpa NPPN, iuran BPJS, atau potongan lain. Bukan nasihat pajak; cek ketentuan terbaru atau konsultan pajak.
Tips melamar
- Sebutkan lokasi dan zona waktumu di bagian atas CV, mis. Jakarta, Indonesia (GMT+7).
- Sesuaikan ringkasan CV dengan kata kunci di deskripsi, terutama Python, SQL, Kafka.
- Tulis hasil kerja dengan angka (mis. "menangani 60 tiket/hari"), bukan hanya tugas.
- Perusahaan resmi tidak pernah meminta biaya untuk melamar atau wawancara.
⚑ Laporkan lowongan ini
Data Platform Engineer (102-08SENG-01)OpsBrasil Serviços Cloud LTDA
Lamar